[ 529.063043] env[69274]: INFO neutron.common.config [-] Logging enabled! [ 529.063479] env[69274]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev38 [ 529.063567] env[69274]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69274) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 529.063914] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 529.064031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 529.064932] env[69274]: WARNING oslo_policy.policy [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.065177] env[69274]: WARNING oslo_policy.policy [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 529.066811] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] VMware NSXv3 Agent initialized successfully. [ 529.067200] env[69274]: DEBUG oslo_concurrency.lockutils [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] Acquiring lock "singleton_lock" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.067345] env[69274]: DEBUG oslo_concurrency.lockutils [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] Acquired lock "singleton_lock" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.067585] env[69274]: DEBUG oslo_concurrency.lockutils [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] Releasing lock "singleton_lock" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.068012] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] Full set of CONF: {{(pid=69274) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 529.068145] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ******************************************************************************** {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 529.068262] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] Configuration options gathered from: {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 529.068605] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 529.068788] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 529.068914] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ================================================================================ {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 529.069123] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] agent_down_time = 75 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.069278] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] allow_automatic_dhcp_failover = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.069445] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] allow_bulk = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.069683] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] api_extensions_path = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.069922] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] api_paste_config = api-paste.ini {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.070191] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] auth_strategy = keystone {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.070393] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] backdoor_port = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.070607] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] backdoor_socket = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.070860] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] backlog = 4096 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.071087] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] base_mac = fa:16:3e:00:00:00 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.071277] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] bind_host = 0.0.0.0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.071435] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] bind_port = 9696 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.071614] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] client_socket_timeout = 900 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.071771] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] config_dir = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.071893] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.072057] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] config_source = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.072213] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] control_exchange = neutron {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.072365] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] core_plugin = ml2 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.072514] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] debug = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.072680] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] default_availability_zones = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.072901] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.073062] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] dhcp_agent_notification = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.073210] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] dhcp_agents_per_network = 1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.073354] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] dhcp_lease_duration = 86400 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.073544] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] dhcp_load_type = networks {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.073669] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] dns_domain = openstacklocal {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.073837] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.073982] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] enable_default_route_bfd = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.074142] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] enable_default_route_ecmp = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.074285] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] enable_dvr = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.074446] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] enable_new_agents = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.074589] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.074726] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] enable_signals = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.074878] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] enable_traditional_dhcp = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.075049] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] external_dns_driver = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.075197] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] filter_validation = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.075348] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] global_physnet_mtu = 8950 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.075488] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] graceful_shutdown_timeout = 60 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.075697] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] host = cpu-1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.075851] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] host_dvr_for_dhcp = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.075997] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] http_retries = 3 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.076159] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] instance_format = [instance: %(uuid)s] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.076302] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.076455] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ipam_driver = internal {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.076615] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ipv6_pd_enabled = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.076763] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] l3_ha = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.076906] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.077063] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] l3_ha_network_physical_name = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.077224] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] l3_ha_network_type = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.077372] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_color = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.077517] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_config_append = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.077662] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.077800] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_dir = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.077936] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_file = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.078056] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_options = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.078207] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_rotate_interval = 1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.078376] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_rotate_interval_type = days {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.078573] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] log_rotation_type = none {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.078695] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.078804] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.078955] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.079111] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.079222] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.079379] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] max_dns_nameservers = 5 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.079541] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] max_header_line = 16384 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.079694] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] max_l3_agents_per_router = 3 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.079836] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] max_logfile_count = 30 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.079974] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] max_logfile_size_mb = 200 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.080123] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] max_subnet_host_routes = 20 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.080269] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] my_ip = 10.180.1.21 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.080412] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] my_ipv6 = ::1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.080569] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] network_auto_schedule = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.080715] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] network_link_prefix = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.080859] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081022] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] notify_nova_on_port_data_changes = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081164] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] notify_nova_on_port_status_changes = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081439] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] pagination_max_limit = -1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081439] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] publish_errors = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081592] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] rate_limit_burst = 0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081707] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] rate_limit_except_level = CRITICAL {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081850] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] rate_limit_interval = 0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.081976] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] retry_until_window = 30 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.082126] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] router_distributed = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.082266] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] rpc_resources_processing_step = 20 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.082406] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] rpc_response_max_timeout = 600 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.082569] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] rpc_response_timeout = 60 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.082727] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] send_events_interval = 2 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.082907] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] service_plugins = ['router'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.083412] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] setproctitle = on {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.083412] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] shell_completion = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.083412] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] state_path = /opt/stack/data/neutron {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.083563] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] syslog_log_facility = LOG_USER {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.083770] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] tcp_keepidle = 600 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.083853] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] transport_url = **** {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.083920] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] use_journal = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.084067] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] use_json = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.084211] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] use_ssl = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.084349] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] use_stderr = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.084494] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] use_syslog = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.084634] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] vlan_qinq = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.084784] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] vlan_transparent = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.084919] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] watch_log_file = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.085079] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] wsgi_default_pool_size = 100 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.085221] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] wsgi_keep_alive = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.085422] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.085799] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] wsgi_server_debug = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 529.085882] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_concurrency.disable_process_locking = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.085971] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.086131] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.086278] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.086427] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.086573] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.086742] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.086901] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.connection_string = messaging:// {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.087056] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.enabled = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.087211] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.es_doc_type = notification {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.087342] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.es_scroll_size = 10000 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.087485] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.es_scroll_time = 2m {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.087626] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.filter_error_trace = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.087775] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.hmac_keys = **** {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.087997] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.sentinel_service_name = mymaster {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.088113] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.socket_timeout = 0.1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.088208] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.trace_requests = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.088346] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler.trace_sqlalchemy = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.088535] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler_jaeger.process_tags = {} {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.088713] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler_jaeger.service_name_prefix = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.088867] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] profiler_otlp.service_name_prefix = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.089075] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.enforce_new_defaults = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.089389] env[69274]: WARNING oslo_config.cfg [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 529.089556] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.enforce_scope = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.089767] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.policy_default_rule = default {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.089880] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.090063] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.090230] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.090388] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.090532] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.090678] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.090850] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.090970] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_policy.remote_timeout = 60.0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.091141] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.091358] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] agent.extensions = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.091534] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.091743] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] service_providers.service_provider = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.091886] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.default_quota = -1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.092066] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.092220] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_floatingip = 50 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.092362] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_network = 100 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.092504] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_port = 500 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.092760] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.092828] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_router = 10 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.092934] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_security_group = 10 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.093095] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.093235] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.quota_subnet = 100 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.093408] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] QUOTAS.track_quota_usage = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.093595] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.093788] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep.group = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.093999] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep.helper_command = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.094088] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.094296] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep.thread_pool_size = 8 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.094383] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep.user = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.094517] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.094661] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_dhcp_release.group = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.094800] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_dhcp_release.helper_command = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.094947] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.095114] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.095276] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_dhcp_release.user = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.095448] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.095648] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_ovs_vsctl.group = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.095738] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_ovs_vsctl.helper_command = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.095884] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.096051] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.096194] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_ovs_vsctl.user = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.096351] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_namespace.capabilities = [21] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.096510] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_namespace.group = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.096667] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_namespace.helper_command = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.096811] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.096954] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_namespace.thread_pool_size = 8 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.097136] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_namespace.user = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.097292] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_conntrack.capabilities = [12] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.097432] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_conntrack.group = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.097570] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_conntrack.helper_command = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.097731] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.097911] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.098033] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_conntrack.user = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.098188] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_link.capabilities = [12, 21] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.098326] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_link.group = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.098489] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_link.helper_command = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.098638] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.098781] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_link.thread_pool_size = 8 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.098941] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] privsep_link.user = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.099132] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.099293] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.099456] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.continue_on_failed_promotions = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.099589] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.dscp = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.099745] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.dscp_inherit = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.099895] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.force_mp_to_policy = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.100055] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.locking_coordinator_url = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.100202] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.log_agent_heartbeats = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.100347] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.logging_expire = 1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.100509] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.100665] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.100819] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.polling_interval = 240 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.100962] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.101137] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.101303] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.report_interval = 30.0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.101457] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.101606] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.101753] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.102140] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.sync_skew = 60 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.102140] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.synchronization_queue_size = 20 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.102266] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT.use_helper_for_ns_read = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.102396] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] SECURITYGROUP.enable_ipset = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.102548] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] SECURITYGROUP.enable_security_group = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.102713] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.102868] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.103029] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] experimental.ipv6_pd_enabled = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.103198] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.extension_drivers = ['port_security'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.103339] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.external_network_type = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.103496] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.103649] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.overlay_ip_version = 4 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.103798] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.path_mtu = 8950 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.103970] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.physical_network_mtus = {} {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.104163] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.tenant_network_types = ['vlan'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.104317] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.104471] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ml2.type_drivers = ['vlan'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.104627] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT_CLI.neutron_port_id = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.104783] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.104928] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.105105] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.105267] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.105414] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.105564] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.105718] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.105866] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.106092] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.106278] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_login_password = **** {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.106443] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_login_port = 443 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.106595] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_login_user = admin {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.106744] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.107065] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.107128] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.107265] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.107506] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.107614] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.107955] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.107955] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.108091] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.108230] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.108394] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.108556] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.108757] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.108977] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.109226] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] vsphere.vsphere_login_password = VMware1! {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.109396] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.109559] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.109756] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.auth_section = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.109921] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.auth_type = password {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.110087] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.110236] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.certfile = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.110383] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.collect_timing = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.110537] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.endpoint_type = public {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.110687] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.insecure = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.110828] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.keyfile = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.110982] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.region_name = RegionOne {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.111162] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.split_loggers = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.111306] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] nova.timeout = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.111454] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.auth_section = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.111610] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.auth_type = password {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.111756] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.111894] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.certfile = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.112047] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.collect_timing = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.112218] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.endpoint_type = public {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.112364] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.insecure = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.112498] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.keyfile = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.112634] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.region_name = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.112776] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.split_loggers = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.112913] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] placement.timeout = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.113078] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.auth_section = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.113223] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.auth_type = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.113377] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.cafile = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.113526] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.certfile = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.113670] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.collect_timing = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.113808] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.connect_retries = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.113944] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.connect_retry_delay = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.114113] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.enable_notifications = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.114283] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.endpoint_override = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.114402] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.insecure = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.114540] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.interface = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.114681] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.keyfile = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.114815] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.max_version = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.114950] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.min_version = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.115097] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.region_name = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.115236] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.retriable_status_codes = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.115388] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.service_name = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.115554] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.service_type = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.115665] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.split_loggers = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.115825] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.status_code_retries = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.116030] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.status_code_retry_delay = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.116190] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.timeout = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.116333] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.valid_interfaces = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.116473] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ironic.version = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.116625] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] cli_script.dry_run = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.116782] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.116926] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.117075] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.117243] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.117409] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.117552] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.117693] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.117837] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.118012] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.118176] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.118318] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.118511] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.118676] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.118823] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.118969] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.119171] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.119317] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.119496] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.119687] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.119839] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.119983] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.120146] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.120292] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.120449] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.120611] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.120794] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.120896] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.121048] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.121192] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.121407] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.121475] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.ssl = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.121645] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.121845] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.122015] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.122178] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.122337] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.ssl_version = {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.122480] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.122641] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_notifications.driver = [] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.122826] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_notifications.retry = -1 {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.122988] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.123184] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 529.123304] env[69274]: DEBUG oslo_service.backend.eventlet.service [None req-7312aef2-90eb-4d14-8a96-c4664b5712bf None None] ******************************************************************************** {{(pid=69274) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 529.124426] env[69274]: DEBUG neutron.agent.securitygroups_rpc [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Init firewall settings (driver=nsxv3) {{(pid=69274) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 529.125957] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69274) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 529.126036] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] RPC agent_id: nsxm-l-01a.corp.local [ 529.128379] env[69274]: DEBUG dogpile.cache.region [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 529.128532] env[69274]: DEBUG dogpile.lock [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 529.128640] env[69274]: DEBUG dogpile.lock [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 529.128739] env[69274]: DEBUG dogpile.lock [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 529.128835] env[69274]: DEBUG dogpile.cache.region [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 529.128926] env[69274]: DEBUG dogpile.lock [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 529.129070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 529.157366] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Session token - acquiring [ 529.161521] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.161521] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.161521] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.161521] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.172097] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.466596] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 529.488190] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 529.488367] env[69274]: DEBUG dogpile.cache.region [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Cache value generated in 0.359 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 529.488523] env[69274]: DEBUG dogpile.lock [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 529.488664] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Activating Policy API Provider. [ 529.488873] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Looking for the default Infrastructure Rules. [ 529.556311] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Looking for the Default Layer3 Logged Drop Section. [ 529.572781] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 529.573276] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 529.573449] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 529.573565] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 529.573852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 529.574206] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.088698] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 530.591364] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.093306] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Inventory metadata is going to be refreshed. [ 531.093685] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 532.021679] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.021918] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.022040] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.022381] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.034315] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 532.035426] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.036440] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 532.054763] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.055081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.055081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.055400] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.055534] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.055712] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 532.056072] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.056072] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 532.076731] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.077020] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.077078] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.077351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.077533] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.077692] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 532.102186] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.102600] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.102600] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.102787] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.102975] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.103214] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 532.123587] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.123842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.123924] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.124272] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.124427] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.124596] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 532.124714] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.124826] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 532.144408] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.144624] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.144736] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.145105] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.145250] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.145409] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 532.145522] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.145638] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 532.166952] env[69274]: DEBUG networking_nsxv3.common.locking [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.167214] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.167267] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.167548] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.167701] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.167860] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 532.167972] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 532.168092] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Inventory metadata have been refreshed. [ 532.168195] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Dryrun:True. Metadata refresh completed. [ 532.168316] env[69274]: DEBUG oslo_concurrency.lockutils [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Releasing lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.170126] env[69274]: INFO neutron.agent.agent_extensions_manager [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Loaded agent extensions: [] [ 532.170850] env[69274]: DEBUG neutron_lib.callbacks.manager [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69274) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 532.221080] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent RPC Daemon Started! [ 532.221235] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:0 started [ 532.221319] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent out of sync with plugin! [ 537.171148] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.171524] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.173497] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.173883] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.012070] env[69274]: INFO networking_nsxv3.common.synchronization [None req-8dbb09e1-859c-4355-b548-8dced777e248 demo admin] Enqueued Resource ID: a6c06bbc-e867-4809-832d-1be33b12c0e1 with Priority: HIGHEST for action security_group_rules [ 547.012597] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6c06bbc-e867-4809-832d-1be33b12c0e1 with Priority: HIGHEST for action security_group_rules [ 547.013599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6c06bbc-e867-4809-832d-1be33b12c0e1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.013599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6c06bbc-e867-4809-832d-1be33b12c0e1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.013599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6c06bbc-e867-4809-832d-1be33b12c0e1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.013599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6c06bbc-e867-4809-832d-1be33b12c0e1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.013890] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6c06bbc-e867-4809-832d-1be33b12c0e1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.532558] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.532782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.532837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.533040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.533143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.533244] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6c06bbc-e867-4809-832d-1be33b12c0e1 already deleted. [ 547.533331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6c06bbc-e867-4809-832d-1be33b12c0e1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.013896] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.014301] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.015087] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.015541] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.016399] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.016749] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.018080] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.018513] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.222214] env[69274]: INFO networking_nsxv3.common.synchronization [None req-2efb38ff-7838-4fb0-bb57-a34c0c54f133 None None] Enqueued Resource ID: 6651486b-bd0f-4113-ba29-6914440732f7 with Priority: HIGHEST for action port [ 570.222214] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6651486b-bd0f-4113-ba29-6914440732f7 with Priority: HIGHEST for action port [ 570.222214] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-6651486b-bd0f-4113-ba29-6914440732f7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.222214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6651486b-bd0f-4113-ba29-6914440732f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.222214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6651486b-bd0f-4113-ba29-6914440732f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.222214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6651486b-bd0f-4113-ba29-6914440732f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.222214] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6651486b-bd0f-4113-ba29-6914440732f7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.726341] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6651486b-bd0f-4113-ba29-6914440732f7 [ 570.726584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.726721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.726790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.727035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.727124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.727239] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6651486b-bd0f-4113-ba29-6914440732f7 already deleted. [ 570.727373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6651486b-bd0f-4113-ba29-6914440732f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.630239] env[69274]: INFO networking_nsxv3.common.synchronization [None req-33bdb607-5075-4767-b569-2e865be06e7a None None] Enqueued Resource ID: 55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4 with Priority: HIGHEST for action port [ 572.630840] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4 with Priority: HIGHEST for action port [ 572.634468] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.634468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.634468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.634468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.634468] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.681105] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b8d97bbe-3829-47a1-9d39-3e8f83f5b7b8 None None] Enqueued Resource ID: a6d1cf23-ca51-4dd7-bff9-31e0b80f4419 with Priority: HIGHEST for action port [ 572.682165] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6d1cf23-ca51-4dd7-bff9-31e0b80f4419 with Priority: HIGHEST for action port [ 572.682392] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6d1cf23-ca51-4dd7-bff9-31e0b80f4419 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.682531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6d1cf23-ca51-4dd7-bff9-31e0b80f4419" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.682600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6d1cf23-ca51-4dd7-bff9-31e0b80f4419" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.683099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6d1cf23-ca51-4dd7-bff9-31e0b80f4419" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.683205] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d1cf23-ca51-4dd7-bff9-31e0b80f4419',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.136524] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4 [ 573.136781] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.136969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.137079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.137302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.137468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.137561] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4 already deleted. [ 573.137644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55d8c6a9-a9a0-4e6e-b56f-a300ada3e5f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.189487] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6d1cf23-ca51-4dd7-bff9-31e0b80f4419 [ 573.189723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.189866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.189938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.190222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.190324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.190431] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6d1cf23-ca51-4dd7-bff9-31e0b80f4419 already deleted. [ 573.190643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6d1cf23-ca51-4dd7-bff9-31e0b80f4419" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.423202] env[69274]: INFO networking_nsxv3.common.synchronization [None req-1608a0cd-f4be-40fe-adb8-f78c0f863302 None None] Enqueued Resource ID: 7eab3236-b760-45bc-95d9-ae6103fccbc8 with Priority: HIGHEST for action port [ 573.423850] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eab3236-b760-45bc-95d9-ae6103fccbc8 with Priority: HIGHEST for action port [ 573.424351] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eab3236-b760-45bc-95d9-ae6103fccbc8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.424351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eab3236-b760-45bc-95d9-ae6103fccbc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.424504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eab3236-b760-45bc-95d9-ae6103fccbc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.424632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eab3236-b760-45bc-95d9-ae6103fccbc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.424719] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eab3236-b760-45bc-95d9-ae6103fccbc8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.927387] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7eab3236-b760-45bc-95d9-ae6103fccbc8 [ 573.928211] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.928211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.928211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.928211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.928211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.929221] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7eab3236-b760-45bc-95d9-ae6103fccbc8 already deleted. [ 573.929221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eab3236-b760-45bc-95d9-ae6103fccbc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.386999] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7b0ba947-40a8-4b0d-add9-f239d8af82de None None] Enqueued Resource ID: 0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041 with Priority: HIGHEST for action port [ 574.387307] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041 with Priority: HIGHEST for action port [ 574.387889] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.388074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.388322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.388390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.388472] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.894364] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041 [ 574.894599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.894776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.895063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.895063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.896928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.896928] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041 already deleted. [ 574.896928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0234fb8a-c1f9-48a8-9b1a-eb7dc62fb041" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.439842] env[69274]: INFO networking_nsxv3.common.synchronization [None req-37b5f67a-55cb-4583-abbb-c2abd890335f None None] Enqueued Resource ID: 5a166f69-0fc9-4a57-864e-cbd8d3f44aa1 with Priority: HIGHEST for action port [ 575.440283] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a166f69-0fc9-4a57-864e-cbd8d3f44aa1 with Priority: HIGHEST for action port [ 575.440333] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a166f69-0fc9-4a57-864e-cbd8d3f44aa1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.440445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a166f69-0fc9-4a57-864e-cbd8d3f44aa1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.440506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a166f69-0fc9-4a57-864e-cbd8d3f44aa1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.440737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a166f69-0fc9-4a57-864e-cbd8d3f44aa1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.440831] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a166f69-0fc9-4a57-864e-cbd8d3f44aa1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.944580] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a166f69-0fc9-4a57-864e-cbd8d3f44aa1 [ 575.945015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.945282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.945735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.946303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.946519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.946802] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a166f69-0fc9-4a57-864e-cbd8d3f44aa1 already deleted. [ 575.947032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a166f69-0fc9-4a57-864e-cbd8d3f44aa1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.932712] env[69274]: INFO networking_nsxv3.common.synchronization [None req-a261aedc-1a56-4336-a378-5b2e7ec0c616 None None] Enqueued Resource ID: 33347de0-8686-446f-9949-2c0aa9b4e2b2 with Priority: HIGHEST for action port [ 576.932997] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33347de0-8686-446f-9949-2c0aa9b4e2b2 with Priority: HIGHEST for action port [ 576.933597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-33347de0-8686-446f-9949-2c0aa9b4e2b2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.933775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33347de0-8686-446f-9949-2c0aa9b4e2b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.933775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33347de0-8686-446f-9949-2c0aa9b4e2b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.934020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33347de0-8686-446f-9949-2c0aa9b4e2b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.935921] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33347de0-8686-446f-9949-2c0aa9b4e2b2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.438130] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33347de0-8686-446f-9949-2c0aa9b4e2b2 [ 577.439468] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.439468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.439468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.439468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.439468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.439468] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33347de0-8686-446f-9949-2c0aa9b4e2b2 already deleted. [ 577.439468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33347de0-8686-446f-9949-2c0aa9b4e2b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.777565] env[69274]: INFO networking_nsxv3.common.synchronization [None req-d520a361-3a3a-4455-8a2f-db1f0674cde7 None None] Enqueued Resource ID: 2158004c-8e0e-4048-a1cc-23e0913635b6 with Priority: HIGHEST for action port [ 577.780938] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2158004c-8e0e-4048-a1cc-23e0913635b6 with Priority: HIGHEST for action port [ 577.785405] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-2158004c-8e0e-4048-a1cc-23e0913635b6 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.785405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2158004c-8e0e-4048-a1cc-23e0913635b6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.785405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2158004c-8e0e-4048-a1cc-23e0913635b6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.785944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2158004c-8e0e-4048-a1cc-23e0913635b6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.785944] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2158004c-8e0e-4048-a1cc-23e0913635b6',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.840949] env[69274]: INFO networking_nsxv3.common.synchronization [None req-a9e7f514-7a53-44d0-90d8-11e6aec96dc2 None None] Enqueued Resource ID: d869aa65-270d-4710-a924-8542261a8575 with Priority: HIGHEST for action port [ 577.841572] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d869aa65-270d-4710-a924-8542261a8575 with Priority: HIGHEST for action port [ 577.841853] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d869aa65-270d-4710-a924-8542261a8575 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.842141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d869aa65-270d-4710-a924-8542261a8575" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.842250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d869aa65-270d-4710-a924-8542261a8575" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.842535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d869aa65-270d-4710-a924-8542261a8575" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.842661] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d869aa65-270d-4710-a924-8542261a8575',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.902960] env[69274]: INFO networking_nsxv3.common.synchronization [None req-86820053-50e2-4f8a-8ca3-9ac6a07bdcbb None None] Enqueued Resource ID: d0ecb2f0-53c9-4f19-a3e9-5861288f928a with Priority: HIGHEST for action port [ 577.903566] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0ecb2f0-53c9-4f19-a3e9-5861288f928a with Priority: HIGHEST for action port [ 577.903812] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0ecb2f0-53c9-4f19-a3e9-5861288f928a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.903866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0ecb2f0-53c9-4f19-a3e9-5861288f928a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.904140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0ecb2f0-53c9-4f19-a3e9-5861288f928a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.905400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0ecb2f0-53c9-4f19-a3e9-5861288f928a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.905400] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0ecb2f0-53c9-4f19-a3e9-5861288f928a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.935562] env[69274]: INFO networking_nsxv3.common.synchronization [None req-97abf978-8d33-4f96-a365-535d81fccf54 None None] Enqueued Resource ID: abac30db-a833-48b1-a70d-caf8d36d1c6c with Priority: HIGHEST for action port [ 577.936402] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abac30db-a833-48b1-a70d-caf8d36d1c6c with Priority: HIGHEST for action port [ 577.936718] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-abac30db-a833-48b1-a70d-caf8d36d1c6c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.936841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abac30db-a833-48b1-a70d-caf8d36d1c6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.936917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abac30db-a833-48b1-a70d-caf8d36d1c6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.937289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abac30db-a833-48b1-a70d-caf8d36d1c6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.938293] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abac30db-a833-48b1-a70d-caf8d36d1c6c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.974589] env[69274]: INFO networking_nsxv3.common.synchronization [None req-8d154f09-6771-4b64-b219-78736fac7933 None None] Enqueued Resource ID: f191cf7e-f95d-410d-b71a-9557d24af677 with Priority: HIGHEST for action port [ 577.974589] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f191cf7e-f95d-410d-b71a-9557d24af677 with Priority: HIGHEST for action port [ 577.975177] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f191cf7e-f95d-410d-b71a-9557d24af677 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.976047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f191cf7e-f95d-410d-b71a-9557d24af677" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.976694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f191cf7e-f95d-410d-b71a-9557d24af677" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.978029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f191cf7e-f95d-410d-b71a-9557d24af677" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.978029] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f191cf7e-f95d-410d-b71a-9557d24af677',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.071696] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3beec397-46dc-4932-9337-9fa50847d880 None None] Enqueued Resource ID: 89600f3b-a3f3-4e12-a902-d8d9bfe19bcf with Priority: HIGHEST for action port [ 578.072218] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89600f3b-a3f3-4e12-a902-d8d9bfe19bcf with Priority: HIGHEST for action port [ 578.075929] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-89600f3b-a3f3-4e12-a902-d8d9bfe19bcf taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.076089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89600f3b-a3f3-4e12-a902-d8d9bfe19bcf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.076169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89600f3b-a3f3-4e12-a902-d8d9bfe19bcf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.076445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89600f3b-a3f3-4e12-a902-d8d9bfe19bcf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.076623] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89600f3b-a3f3-4e12-a902-d8d9bfe19bcf',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.290649] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2158004c-8e0e-4048-a1cc-23e0913635b6 [ 578.290649] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.290858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.290858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.291134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.291134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.291222] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2158004c-8e0e-4048-a1cc-23e0913635b6 already deleted. [ 578.291275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2158004c-8e0e-4048-a1cc-23e0913635b6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.345295] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d869aa65-270d-4710-a924-8542261a8575 [ 578.345817] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.346962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.346962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.347324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.347455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.347603] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d869aa65-270d-4710-a924-8542261a8575 already deleted. [ 578.347692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d869aa65-270d-4710-a924-8542261a8575" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.408676] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0ecb2f0-53c9-4f19-a3e9-5861288f928a [ 578.408676] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.408676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.408676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.408676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.408676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.408676] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0ecb2f0-53c9-4f19-a3e9-5861288f928a already deleted. [ 578.408676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0ecb2f0-53c9-4f19-a3e9-5861288f928a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.440649] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abac30db-a833-48b1-a70d-caf8d36d1c6c [ 578.440649] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.440935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.440935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.442034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.442034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.442034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abac30db-a833-48b1-a70d-caf8d36d1c6c already deleted. [ 578.442034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abac30db-a833-48b1-a70d-caf8d36d1c6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.487510] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f191cf7e-f95d-410d-b71a-9557d24af677 [ 578.487510] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.487510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.487510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.487671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.487702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.487809] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f191cf7e-f95d-410d-b71a-9557d24af677 already deleted. [ 578.489030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f191cf7e-f95d-410d-b71a-9557d24af677" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.579253] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89600f3b-a3f3-4e12-a902-d8d9bfe19bcf [ 578.579710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.580091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.580515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.582730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.582843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.582940] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89600f3b-a3f3-4e12-a902-d8d9bfe19bcf already deleted. [ 578.583040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89600f3b-a3f3-4e12-a902-d8d9bfe19bcf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.967961] env[69274]: INFO networking_nsxv3.common.synchronization [None req-16369f28-a60d-42dd-bf4a-6142f80a5106 None None] Enqueued Resource ID: d31731c7-578d-4409-aa5e-2da749e958a8 with Priority: HIGHEST for action port [ 580.968542] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31731c7-578d-4409-aa5e-2da749e958a8 with Priority: HIGHEST for action port [ 580.969487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d31731c7-578d-4409-aa5e-2da749e958a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.970292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d31731c7-578d-4409-aa5e-2da749e958a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.970384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d31731c7-578d-4409-aa5e-2da749e958a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.970647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d31731c7-578d-4409-aa5e-2da749e958a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.970729] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d31731c7-578d-4409-aa5e-2da749e958a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.475238] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d31731c7-578d-4409-aa5e-2da749e958a8 [ 581.476438] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.476438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.476438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.476438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.476438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.476438] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d31731c7-578d-4409-aa5e-2da749e958a8 already deleted. [ 581.476438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d31731c7-578d-4409-aa5e-2da749e958a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.599300] env[69274]: INFO networking_nsxv3.common.synchronization [None req-cd03c920-db01-4607-9910-b34b46e20ea5 None None] Enqueued Resource ID: 8761178f-a174-4cdc-9ab7-282594e6f243 with Priority: HIGHEST for action port [ 581.605015] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8761178f-a174-4cdc-9ab7-282594e6f243 with Priority: HIGHEST for action port [ 581.605015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8761178f-a174-4cdc-9ab7-282594e6f243 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.605015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8761178f-a174-4cdc-9ab7-282594e6f243" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.605015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8761178f-a174-4cdc-9ab7-282594e6f243" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.605015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8761178f-a174-4cdc-9ab7-282594e6f243" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.605015] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8761178f-a174-4cdc-9ab7-282594e6f243',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.107652] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8761178f-a174-4cdc-9ab7-282594e6f243 [ 582.107652] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.108318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.108318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.108318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.108318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.108318] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8761178f-a174-4cdc-9ab7-282594e6f243 already deleted. [ 582.108593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8761178f-a174-4cdc-9ab7-282594e6f243" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.820078] env[69274]: INFO networking_nsxv3.common.synchronization [req-1da022bb-caa2-4d0c-a181-e2c72756076a req-138fb629-d0ce-466f-bd17-58db2da0464a tempest-DeleteServersAdminTestJSON-1417661457 tempest-DeleteServersAdminTestJSON-1417661457-project-member] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 582.820659] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 582.820961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.824118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.824193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.824478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.824638] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.824817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.824817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.824976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.825078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.825179] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.329270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.329270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.329270] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 already deleted. [ 583.329270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.798644] env[69274]: INFO networking_nsxv3.common.synchronization [None req-90a19d59-8512-4c67-9751-fe3d5fb41f72 None None] Enqueued Resource ID: d460a46a-94c7-4b96-925b-af63d9c9c594 with Priority: HIGHEST for action port [ 583.798889] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d460a46a-94c7-4b96-925b-af63d9c9c594 with Priority: HIGHEST for action port [ 583.799514] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d460a46a-94c7-4b96-925b-af63d9c9c594 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.800562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d460a46a-94c7-4b96-925b-af63d9c9c594" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.800726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d460a46a-94c7-4b96-925b-af63d9c9c594" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.801148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d460a46a-94c7-4b96-925b-af63d9c9c594" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.801327] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d460a46a-94c7-4b96-925b-af63d9c9c594',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.305927] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d460a46a-94c7-4b96-925b-af63d9c9c594 [ 584.305927] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.305927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.305927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.305927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.305927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.305927] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d460a46a-94c7-4b96-925b-af63d9c9c594 already deleted. [ 584.305927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d460a46a-94c7-4b96-925b-af63d9c9c594" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.540766] env[69274]: INFO networking_nsxv3.common.synchronization [req-bc2090db-1969-4e28-b92a-47b549ee6494 req-0937fafc-d183-4e17-8c4b-fc4403a8353f tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 584.541697] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 584.541983] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.542141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.542226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.542467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.542657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.543054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.543146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.543286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.543386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.543551] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.046746] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.047538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.047538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.047981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.048536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.049143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.049412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.049708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.050592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.050822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.050822] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 already deleted. [ 585.051014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.299567] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7b21fe7b-bed9-4745-a5b0-aeec31e19062 None None] Enqueued Resource ID: bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05 with Priority: HIGHEST for action port [ 585.300367] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05 with Priority: HIGHEST for action port [ 585.300728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.301012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.301012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.301318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.301318] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.304841] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.305613] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.305796] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.306516] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.306516] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.306961] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.307189] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.307718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.307718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.308102] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.308411] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.308731] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.308808] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.309585] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.309585] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.309585] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.340524] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.340524] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 585.340524] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.340524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.340524] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-8a44e450-143a-45c0-a0cc-d475e5706ab5 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.340524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.341322] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.341322] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.341322] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a44e450-143a-45c0-a0cc-d475e5706ab5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.787375] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-704 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.787375] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.787375] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.788582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.788932] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.789130] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.790329] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.790629] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.790787] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.791044] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.791173] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.791251] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.791364] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.791478] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.791583] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.792054] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.814669] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.815112] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 585.815185] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.815421] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.815682] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-0188b7be-ae1c-4920-aec0-a20a04e50704 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.818978] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.818978] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.818978] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.818978] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0188b7be-ae1c-4920-aec0-a20a04e50704',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.818978] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05 [ 585.818978] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.818978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.819350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.819350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.819407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.819817] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05 already deleted. [ 585.819817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb2ffe9c-2b95-4f38-9a45-4cea4cc83c05" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.843825] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.844638] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.844638] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.844638] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.844638] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.845031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 8a44e450-143a-45c0-a0cc-d475e5706ab5 not found, creating... [ 585.845066] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.847029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.847029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.847029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.847029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.847249] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.848435] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.848435] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.848435] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.848435] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.849235] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 8a44e450-143a-45c0-a0cc-d475e5706ab5 is going to be created. [ 585.871748] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.872341] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.872552] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.872839] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.873081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.873332] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.132828] env[69274]: INFO networking_nsxv3.common.synchronization [None req-dec324d1-a34a-463a-b73f-ad18c7174306 tempest-VolumesAdminNegativeTest-289876529 tempest-VolumesAdminNegativeTest-289876529-project-member] Enqueued Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_rules [ 586.132828] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_rules [ 586.132828] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.132828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.132828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.132828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.132828] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.247509] env[69274]: INFO networking_nsxv3.common.synchronization [None req-a04771ba-d166-426b-8f24-9c37941a65af None None] Enqueued Resource ID: 003b89c5-1bf8-4f14-bdaf-b0908e0a086e with Priority: HIGHEST for action port [ 586.248063] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 003b89c5-1bf8-4f14-bdaf-b0908e0a086e with Priority: HIGHEST for action port [ 586.248386] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-003b89c5-1bf8-4f14-bdaf-b0908e0a086e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.248508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-003b89c5-1bf8-4f14-bdaf-b0908e0a086e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.248575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-003b89c5-1bf8-4f14-bdaf-b0908e0a086e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.248833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-003b89c5-1bf8-4f14-bdaf-b0908e0a086e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.248922] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('003b89c5-1bf8-4f14-bdaf-b0908e0a086e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.329676] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.330028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.330248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.330553] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.330682] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.330843] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 0188b7be-ae1c-4920-aec0-a20a04e50704 not found, creating... [ 586.331157] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.331295] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.331466] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.332289] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.332289] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.332289] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.332537] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.332537] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.334201] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.334201] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.334201] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 0188b7be-ae1c-4920-aec0-a20a04e50704 is going to be created. [ 586.360724] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.360837] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.361033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.361263] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.361657] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.361744] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.518826] env[69274]: INFO networking_nsxv3.common.synchronization [None req-9aeb5d0c-b3f9-4684-9ca7-23a1d1a30c62 None None] Enqueued Resource ID: 1f99ae23-6c7b-4c8f-a948-830e50fd4d1c with Priority: HIGHEST for action port [ 586.519520] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f99ae23-6c7b-4c8f-a948-830e50fd4d1c with Priority: HIGHEST for action port [ 586.519816] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f99ae23-6c7b-4c8f-a948-830e50fd4d1c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.519928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f99ae23-6c7b-4c8f-a948-830e50fd4d1c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.519995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f99ae23-6c7b-4c8f-a948-830e50fd4d1c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.521026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f99ae23-6c7b-4c8f-a948-830e50fd4d1c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.521169] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f99ae23-6c7b-4c8f-a948-830e50fd4d1c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.644175] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b34e8a1a-48df-4bf4-a3a6-7912b674fed4 tempest-VolumesAdminNegativeTest-289876529 tempest-VolumesAdminNegativeTest-289876529-project-member] Enqueued Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_rules [ 586.644175] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_rules [ 586.644175] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.644175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.664907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.664907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.664907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.664907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.664907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.664907] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 already deleted. [ 586.664907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.664907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.664907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.664907] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.751089] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 003b89c5-1bf8-4f14-bdaf-b0908e0a086e [ 586.752721] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.752721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.752721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.752721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.752721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.754034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:003b89c5-1bf8-4f14-bdaf-b0908e0a086e already deleted. [ 586.754034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-003b89c5-1bf8-4f14-bdaf-b0908e0a086e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.996673] env[69274]: INFO networking_nsxv3.common.synchronization [None req-378bd7c2-2e1b-4ddf-896c-5bb852cf6153 None None] Enqueued Resource ID: ae062397-b669-40ab-9fc8-38f0ed29b330 with Priority: HIGHEST for action port [ 586.996936] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae062397-b669-40ab-9fc8-38f0ed29b330 with Priority: HIGHEST for action port [ 586.997581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae062397-b669-40ab-9fc8-38f0ed29b330 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.997736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae062397-b669-40ab-9fc8-38f0ed29b330" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.997830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae062397-b669-40ab-9fc8-38f0ed29b330" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.998367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae062397-b669-40ab-9fc8-38f0ed29b330" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.998473] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae062397-b669-40ab-9fc8-38f0ed29b330',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.025747] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f99ae23-6c7b-4c8f-a948-830e50fd4d1c [ 587.026078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.026470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.026670] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.026844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.027137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.027349] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f99ae23-6c7b-4c8f-a948-830e50fd4d1c already deleted. [ 587.027521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f99ae23-6c7b-4c8f-a948-830e50fd4d1c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.168503] env[69274]: INFO networking_nsxv3.common.synchronization [req-a0fb009a-0fe4-41bb-ab32-b9855d3c3304 req-e75ba2ec-6e5c-4e2b-b40e-8e332db92955 tempest-TenantUsagesTestJSON-287331542 tempest-TenantUsagesTestJSON-287331542-project-member] Enqueued Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_members [ 587.169482] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_members [ 587.169993] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5386bc-1dac-4dfb-a842-4c99e33f110c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.170158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.170234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.170519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.170752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.170833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.170892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.171073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.171156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.171253] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.174097] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.174097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.174097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.174689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.174689] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.196390] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.196806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.196806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.196985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.196985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.198930] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 already deleted. [ 587.198930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.501376] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae062397-b669-40ab-9fc8-38f0ed29b330 [ 587.501376] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.501376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.501376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.501583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.501583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.501583] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae062397-b669-40ab-9fc8-38f0ed29b330 already deleted. [ 587.501758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae062397-b669-40ab-9fc8-38f0ed29b330" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.677265] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.677862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.677862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.677862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.677862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.678110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.678355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.678355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.678355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.678787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.678787] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c already deleted. [ 587.678787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.694939] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.197362] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.468944] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7229040c-bfe9-4ef4-a028-eaa45b5354e0 None None] Enqueued Resource ID: 31d70607-f91c-41f2-a1d5-e74eeebde467 with Priority: HIGHEST for action port [ 588.469624] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d70607-f91c-41f2-a1d5-e74eeebde467 with Priority: HIGHEST for action port [ 588.471652] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d70607-f91c-41f2-a1d5-e74eeebde467 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.471652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d70607-f91c-41f2-a1d5-e74eeebde467" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.471652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d70607-f91c-41f2-a1d5-e74eeebde467" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.471652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d70607-f91c-41f2-a1d5-e74eeebde467" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.471652] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d70607-f91c-41f2-a1d5-e74eeebde467',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.589966] env[69274]: INFO networking_nsxv3.common.synchronization [req-1da022bb-caa2-4d0c-a181-e2c72756076a req-975b5749-d6f2-402d-932e-b07ab0e33c52 service nova] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_rules [ 588.589966] env[69274]: INFO networking_nsxv3.common.synchronization [req-1da022bb-caa2-4d0c-a181-e2c72756076a req-975b5749-d6f2-402d-932e-b07ab0e33c52 service nova] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 588.590178] env[69274]: INFO networking_nsxv3.common.synchronization [req-1da022bb-caa2-4d0c-a181-e2c72756076a req-975b5749-d6f2-402d-932e-b07ab0e33c52 service nova] Enqueued Resource ID: 8a44e450-143a-45c0-a0cc-d475e5706ab5 with Priority: HIGHEST for action port [ 588.590284] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_rules [ 588.591146] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 588.591146] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a44e450-143a-45c0-a0cc-d475e5706ab5 with Priority: HIGHEST for action port [ 588.592890] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.593119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.593202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.593585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.593782] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.595014] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.595125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.595168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.595403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.595511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.595644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.595692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.595816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.596166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.596166] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.598036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a44e450-143a-45c0-a0cc-d475e5706ab5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.598176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.598223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.598777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.598777] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a44e450-143a-45c0-a0cc-d475e5706ab5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.703453] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 588.703579] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 588.974452] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31d70607-f91c-41f2-a1d5-e74eeebde467 [ 588.974874] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.974874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.974874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.975137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.975214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.975327] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31d70607-f91c-41f2-a1d5-e74eeebde467 already deleted. [ 588.975421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d70607-f91c-41f2-a1d5-e74eeebde467" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.007542] env[69274]: INFO networking_nsxv3.common.synchronization [None req-056f8fa6-0c26-4a61-8de2-e22f27f633b3 None None] Enqueued Resource ID: 857f837f-fd4d-4d68-86ef-f0230614b47a with Priority: HIGHEST for action port [ 589.007814] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857f837f-fd4d-4d68-86ef-f0230614b47a with Priority: HIGHEST for action port [ 589.008507] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-857f837f-fd4d-4d68-86ef-f0230614b47a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.008669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-857f837f-fd4d-4d68-86ef-f0230614b47a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.008708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-857f837f-fd4d-4d68-86ef-f0230614b47a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.008943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-857f837f-fd4d-4d68-86ef-f0230614b47a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.009473] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('857f837f-fd4d-4d68-86ef-f0230614b47a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.026155] env[69274]: INFO networking_nsxv3.common.synchronization [None req-6430f895-b69f-452d-a2ee-f22ed66293be None None] Enqueued Resource ID: 8cb7226f-3ff7-41d0-903b-1787333102c0 with Priority: HIGHEST for action port [ 589.026155] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb7226f-3ff7-41d0-903b-1787333102c0 with Priority: HIGHEST for action port [ 589.026155] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cb7226f-3ff7-41d0-903b-1787333102c0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.026155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cb7226f-3ff7-41d0-903b-1787333102c0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.026155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cb7226f-3ff7-41d0-903b-1787333102c0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.026430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cb7226f-3ff7-41d0-903b-1787333102c0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.027042] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cb7226f-3ff7-41d0-903b-1787333102c0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.100127] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.101478] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.101478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.110607] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a44e450-143a-45c0-a0cc-d475e5706ab5 with status ACTIVE [ 589.110607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.110607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.110607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.110607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.111278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.111278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.111278] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a44e450-143a-45c0-a0cc-d475e5706ab5 is going to be updated. [ 589.143886] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.144144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.144144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.144323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.144461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.144619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.171491] env[69274]: INFO networking_nsxv3.common.synchronization [req-bc2090db-1969-4e28-b92a-47b549ee6494 req-08c16000-4dc0-42b8-9eff-ff5b7f2c445b service nova] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_rules [ 589.171727] env[69274]: INFO networking_nsxv3.common.synchronization [req-bc2090db-1969-4e28-b92a-47b549ee6494 req-08c16000-4dc0-42b8-9eff-ff5b7f2c445b service nova] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 589.171878] env[69274]: INFO networking_nsxv3.common.synchronization [req-bc2090db-1969-4e28-b92a-47b549ee6494 req-08c16000-4dc0-42b8-9eff-ff5b7f2c445b service nova] Enqueued Resource ID: 0188b7be-ae1c-4920-aec0-a20a04e50704 with Priority: HIGHEST for action port [ 589.172148] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_rules [ 589.172261] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 589.172394] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0188b7be-ae1c-4920-aec0-a20a04e50704 with Priority: HIGHEST for action port [ 589.172883] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.175069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.175133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.176040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.176040] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.177630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.177630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.177630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.177848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.178150] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.178150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.178150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.178440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.178440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.178440] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.179251] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-0188b7be-ae1c-4920-aec0-a20a04e50704 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.179596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.179596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.179596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.180625] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0188b7be-ae1c-4920-aec0-a20a04e50704',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.297195] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.297195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.297195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.297195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.297195] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.297195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.297195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.297195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.297195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.297195] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.298157] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.298456] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.298773] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.299064] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.299539] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.299841] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.320043] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.320293] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 589.320371] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.323198] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.323571] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.323797] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.323950] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.324422] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.324717] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f16cff9-a5b2-4b93-b66c-9fb34808bde1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.407897] env[69274]: INFO networking_nsxv3.common.synchronization [None req-47df4305-13ab-4e54-8ced-fa845add7614 None None] Enqueued Resource ID: 88efbc50-68ed-4f1d-b262-7450b49251f9 with Priority: HIGHEST for action port [ 589.408202] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88efbc50-68ed-4f1d-b262-7450b49251f9 with Priority: HIGHEST for action port [ 589.408789] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-88efbc50-68ed-4f1d-b262-7450b49251f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.408934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88efbc50-68ed-4f1d-b262-7450b49251f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.408998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88efbc50-68ed-4f1d-b262-7450b49251f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.415511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88efbc50-68ed-4f1d-b262-7450b49251f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.415685] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88efbc50-68ed-4f1d-b262-7450b49251f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.512292] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 857f837f-fd4d-4d68-86ef-f0230614b47a [ 589.512505] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.512631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.512695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.512893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.512982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.513107] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:857f837f-fd4d-4d68-86ef-f0230614b47a already deleted. [ 589.513190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-857f837f-fd4d-4d68-86ef-f0230614b47a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.514112] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-29d9f9f3-be32-4a63-8491-1f252965f680 tempest-ListServersNegativeTestJSON-719866848 tempest-ListServersNegativeTestJSON-719866848-project-member] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 589.514818] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 589.515376] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.515494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.515557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.515778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.515924] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.516031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.516100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.516239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.516324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.516476] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.528738] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cb7226f-3ff7-41d0-903b-1787333102c0 [ 589.529053] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.529117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.529179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.529412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.529502] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.529596] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cb7226f-3ff7-41d0-903b-1787333102c0 already deleted. [ 589.529676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cb7226f-3ff7-41d0-903b-1787333102c0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.555419] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.555564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.555632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.555861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.571899] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 589.575153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.576321] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 589.597486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.597642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.597710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.597920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.598315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.598574] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 589.598651] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'8a44e450-143a-45c0-a0cc-d475e5706ab5'} {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 589.598735] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 589.601848] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.619931] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.620095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.620162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.620446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.623327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.623754] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 589.647873] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.648029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.648097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.648365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.648406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.648516] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 589.678024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.678024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.678024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.678024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.678024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.678024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 589.678024] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 589.678024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 589.681437] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.681591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.681709] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.682616] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0188b7be-ae1c-4920-aec0-a20a04e50704 with status ACTIVE [ 589.682794] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.682911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.682975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.683190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.683279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.683456] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.683551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.683610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.683759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.683830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.684014] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.684108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.684165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.684300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.684368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.684473] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0188b7be-ae1c-4920-aec0-a20a04e50704 is going to be updated. [ 589.698785] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.698987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.699073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.699285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.699419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.699533] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 589.699604] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 589.699676] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 589.711974] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.712187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.712298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.712554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.712742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.712942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0188b7be-ae1c-4920-aec0-a20a04e50704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.726403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.726975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.727085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.727320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.727441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.728062] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 589.728246] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 589.728344] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 589.728415] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 589.728501] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a44e450-143a-45c0-a0cc-d475e5706ab5 with Priority: HIGH for action port [ 589.728595] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 589.728678] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 589.728743] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 589.729340] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 589.729632] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 589.729721] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 589.759097] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.760061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.760061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.760061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.760061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.760061] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 589.782669] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.782669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.782669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.782669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.782669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.803210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.827691] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.827950] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.828140] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.828457] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.828622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.829624] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 3f16cff9-a5b2-4b93-b66c-9fb34808bde1 not found, creating... [ 589.829624] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.829624] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.829624] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.829845] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.829845] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.830878] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.831234] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.831373] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.833151] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.833325] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.833509] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 3f16cff9-a5b2-4b93-b66c-9fb34808bde1 is going to be created. [ 589.877403] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.877403] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.877403] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.877403] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.877403] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.877403] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.918893] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88efbc50-68ed-4f1d-b262-7450b49251f9 [ 589.920503] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.920503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.920503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.920503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.920503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.920503] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88efbc50-68ed-4f1d-b262-7450b49251f9 already deleted. [ 589.920503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88efbc50-68ed-4f1d-b262-7450b49251f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.018660] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.018820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.018895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.019161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.019261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.019535] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.019643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.019677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.019830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.019908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.019994] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 already deleted. [ 590.020089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.065683] env[69274]: INFO networking_nsxv3.common.synchronization [None req-0244010c-51e6-4825-9734-d5b9a0de6186 None None] Enqueued Resource ID: 351c4c3e-8485-4bc1-a9f3-5bfea58790c8 with Priority: HIGHEST for action port [ 590.066260] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351c4c3e-8485-4bc1-a9f3-5bfea58790c8 with Priority: HIGHEST for action port [ 590.066499] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a44e450-143a-45c0-a0cc-d475e5706ab5 with Priority: HIGH for action port [ 590.066711] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-351c4c3e-8485-4bc1-a9f3-5bfea58790c8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.066809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-351c4c3e-8485-4bc1-a9f3-5bfea58790c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.066994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-351c4c3e-8485-4bc1-a9f3-5bfea58790c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.067167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-351c4c3e-8485-4bc1-a9f3-5bfea58790c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.067357] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('351c4c3e-8485-4bc1-a9f3-5bfea58790c8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.068062] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a44e450-143a-45c0-a0cc-d475e5706ab5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.068171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.068242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.068410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.068486] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a44e450-143a-45c0-a0cc-d475e5706ab5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.104531] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.104895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.104895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.105023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.105069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.105165] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be created. [ 590.149305] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.149305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.149305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.149305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.149305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.162426] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: UNINITIALIZED for 2s [ 590.187398] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.571239] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 351c4c3e-8485-4bc1-a9f3-5bfea58790c8 [ 590.571517] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.572674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.572674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.572674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.572674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.572674] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:351c4c3e-8485-4bc1-a9f3-5bfea58790c8 already deleted. [ 590.572674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-351c4c3e-8485-4bc1-a9f3-5bfea58790c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.572674] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a44e450-143a-45c0-a0cc-d475e5706ab5 with status ACTIVE [ 590.572674] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.572674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.572674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.573067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.573067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.573204] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.573204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.573303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.573417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.573446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.574757] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.574757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.574757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.574757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.574757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.574757] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a44e450-143a-45c0-a0cc-d475e5706ab5 is going to be updated. [ 590.599597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.599728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.599728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.600769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.600769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.600769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a44e450-143a-45c0-a0cc-d475e5706ab5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.694025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.694025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.694025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.694025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.694025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.694025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be created. [ 590.726894] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.727707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.727707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.727707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.727707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.742696] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: UNINITIALIZED for 2s [ 591.009593] env[69274]: INFO networking_nsxv3.common.synchronization [None req-cefe7918-f0af-4cb9-b784-9eaf6a2be2b9 None None] Enqueued Resource ID: b4739638-f0cf-4799-bef1-f1bab3ee7ae8 with Priority: HIGHEST for action port [ 591.009593] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4739638-f0cf-4799-bef1-f1bab3ee7ae8 with Priority: HIGHEST for action port [ 591.010245] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4739638-f0cf-4799-bef1-f1bab3ee7ae8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.010245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4739638-f0cf-4799-bef1-f1bab3ee7ae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.010245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4739638-f0cf-4799-bef1-f1bab3ee7ae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.010591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4739638-f0cf-4799-bef1-f1bab3ee7ae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.010591] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4739638-f0cf-4799-bef1-f1bab3ee7ae8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.515121] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-0b6c5d5a-996d-476a-b65c-5a90ff50e4a9 tempest-ListServersNegativeTestJSON-719866848 tempest-ListServersNegativeTestJSON-719866848-project-member] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 591.515352] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4739638-f0cf-4799-bef1-f1bab3ee7ae8 [ 591.515433] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.515706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.515706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.515838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.516087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.516087] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4739638-f0cf-4799-bef1-f1bab3ee7ae8 already deleted. [ 591.516087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4739638-f0cf-4799-bef1-f1bab3ee7ae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.518517] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 591.518517] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.518517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.520019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.520249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.520465] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.520582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.520657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.520824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.520909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.521037] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.678358] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.678358] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.678789] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.679180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.679305] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.679599] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.679790] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.680071] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.680242] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.680607] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.680607] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.680699] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.680728] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.680844] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.680948] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.681107] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.701983] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.702608] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 591.702829] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.703021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.703413] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-3609491e-6b56-4abd-85ea-870cf696133d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.703542] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.703666] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.704010] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.707416] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3609491e-6b56-4abd-85ea-870cf696133d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.774211] env[69274]: INFO networking_nsxv3.common.synchronization [req-a0fb009a-0fe4-41bb-ab32-b9855d3c3304 req-6a613341-be0a-400a-8c11-1ca42489c688 service nova] Enqueued Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_rules [ 591.774211] env[69274]: INFO networking_nsxv3.common.synchronization [req-a0fb009a-0fe4-41bb-ab32-b9855d3c3304 req-6a613341-be0a-400a-8c11-1ca42489c688 service nova] Enqueued Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_members [ 591.774211] env[69274]: INFO networking_nsxv3.common.synchronization [req-a0fb009a-0fe4-41bb-ab32-b9855d3c3304 req-6a613341-be0a-400a-8c11-1ca42489c688 service nova] Enqueued Resource ID: 3f16cff9-a5b2-4b93-b66c-9fb34808bde1 with Priority: HIGHEST for action port [ 591.774805] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_rules [ 591.775066] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_members [ 591.779133] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f16cff9-a5b2-4b93-b66c-9fb34808bde1 with Priority: HIGHEST for action port [ 591.781572] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf5386bc-1dac-4dfb-a842-4c99e33f110c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.781572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.781572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.781572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.781572] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.781572] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5386bc-1dac-4dfb-a842-4c99e33f110c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.781572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.781572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.781572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.781572] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.781572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.782290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.782672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.782950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.783167] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.784901] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.785199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.787419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.789185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.789185] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f16cff9-a5b2-4b93-b66c-9fb34808bde1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.026131] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.026311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.026782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.026782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.026782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.027053] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.027211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.029848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.029848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.029848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.029848] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 already deleted. [ 592.029848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.048608] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7874586b-b3ef-457d-8677-80fdce11a1d4 None None] Enqueued Resource ID: bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8 with Priority: HIGHEST for action port [ 592.049187] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8 with Priority: HIGHEST for action port [ 592.049564] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.049782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.049782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.053677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.053677] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.173895] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: UNINITIALIZED for 4s [ 592.209890] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.210277] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.210277] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.210691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.210691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.210804] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 3609491e-6b56-4abd-85ea-870cf696133d not found, creating... [ 592.211078] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.211327] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.215085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.215085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.215085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.215085] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.215085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.215085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.215085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.215085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.215085] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 3609491e-6b56-4abd-85ea-870cf696133d is going to be created. [ 592.238291] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.238575] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.238696] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.238979] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.239224] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.239575] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.291976] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5386bc-1dac-4dfb-a842-4c99e33f110c taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.295935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.295935] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.295935] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f16cff9-a5b2-4b93-b66c-9fb34808bde1 with status ACTIVE [ 592.295935] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.295935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.295935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.295935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.295935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.295935] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.295935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.298570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.298783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.298868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.299096] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.299641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.299641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.301087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.301087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.302199] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f16cff9-a5b2-4b93-b66c-9fb34808bde1 is going to be updated. [ 592.329904] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.330318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.331067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.331067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.331067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.331850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f16cff9-a5b2-4b93-b66c-9fb34808bde1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.563060] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8 [ 592.563308] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.563447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.563516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.563831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.563975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.564048] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8 already deleted. [ 592.564113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbf49ccf-9ae6-4a4e-8b12-b83958c10eb8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.759948] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 592.760263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.760436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.760693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.760894] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.761051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.761119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.761276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.761357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.761441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.761529] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.804486] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.986929] env[69274]: INFO networking_nsxv3.common.synchronization [None req-28421733-1c81-4e80-b3bf-991f9a2691de None None] Enqueued Resource ID: 6794962d-5538-414d-bfaa-ba755a955b38 with Priority: HIGHEST for action port [ 592.989129] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6794962d-5538-414d-bfaa-ba755a955b38 with Priority: HIGHEST for action port [ 592.989129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-6794962d-5538-414d-bfaa-ba755a955b38 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.989129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6794962d-5538-414d-bfaa-ba755a955b38" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.989129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6794962d-5538-414d-bfaa-ba755a955b38" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.989691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6794962d-5538-414d-bfaa-ba755a955b38" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.989691] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6794962d-5538-414d-bfaa-ba755a955b38',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.233292] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.233292] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.233422] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.233737] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.236087] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.236413] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.236624] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.237056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.238394] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.238488] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.238660] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.239194] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.239355] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.240266] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 593.240868] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.240868] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.262857] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.263032] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 593.263171] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.263346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.263656] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-61689d60-1d3e-4a58-9e2b-eed68539431d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.263826] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.263940] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.265413] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.265553] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61689d60-1d3e-4a58-9e2b-eed68539431d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.267263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.267413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.267528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.269210] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.269210] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.269210] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.269210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.270383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.270507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.270613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.270732] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.287273] env[69274]: INFO networking_nsxv3.common.synchronization [None req-17b5b68b-61d8-4a07-a0ff-bd16d04c0683 None None] Enqueued Resource ID: 80dd41f0-cda2-4b89-99db-5abad533ae9b with Priority: HIGHEST for action port [ 593.287273] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80dd41f0-cda2-4b89-99db-5abad533ae9b with Priority: HIGHEST for action port [ 593.287273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-80dd41f0-cda2-4b89-99db-5abad533ae9b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.287273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80dd41f0-cda2-4b89-99db-5abad533ae9b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.287273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80dd41f0-cda2-4b89-99db-5abad533ae9b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.287273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80dd41f0-cda2-4b89-99db-5abad533ae9b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.287273] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80dd41f0-cda2-4b89-99db-5abad533ae9b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.307653] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.308798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.308798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.308798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.309000] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.309229] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c is going to be created. [ 593.344778] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.344974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.345060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.345283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.345487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.357805] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c in Status: UNINITIALIZED for 2s [ 593.495382] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6794962d-5538-414d-bfaa-ba755a955b38 [ 593.496453] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.496453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.496453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.496453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.496453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.496453] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6794962d-5538-414d-bfaa-ba755a955b38 already deleted. [ 593.496453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6794962d-5538-414d-bfaa-ba755a955b38" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.684845] env[69274]: INFO networking_nsxv3.common.synchronization [None req-f6be816a-4ff7-41a6-bd2b-306c9efa1b5a None None] Enqueued Resource ID: 676fe78e-8034-4a2e-ba53-7a214b3300d8 with Priority: HIGHEST for action port [ 593.684845] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 676fe78e-8034-4a2e-ba53-7a214b3300d8 with Priority: HIGHEST for action port [ 593.684845] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-676fe78e-8034-4a2e-ba53-7a214b3300d8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.684845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-676fe78e-8034-4a2e-ba53-7a214b3300d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.684845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-676fe78e-8034-4a2e-ba53-7a214b3300d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.684845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-676fe78e-8034-4a2e-ba53-7a214b3300d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.684845] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('676fe78e-8034-4a2e-ba53-7a214b3300d8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.774404] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.774795] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.775260] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.775715] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.775983] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.776270] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 61689d60-1d3e-4a58-9e2b-eed68539431d not found, creating... [ 593.776831] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.778164] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.778408] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.778790] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.778980] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.779476] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.779722] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.779890] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.780227] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.780420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.780632] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 61689d60-1d3e-4a58-9e2b-eed68539431d is going to be created. [ 593.788132] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 093f0a21-7741-4a8f-8410-d5b196f0f7d7: rpc.has_security_group_logging(os_id): False [ 593.792584] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80dd41f0-cda2-4b89-99db-5abad533ae9b [ 593.792811] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.792976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.793139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.793447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.793599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.793743] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80dd41f0-cda2-4b89-99db-5abad533ae9b already deleted. [ 593.793856] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80dd41f0-cda2-4b89-99db-5abad533ae9b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.824556] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.826902] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.826902] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.826902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.827561] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.827561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.827561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.828118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.828335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.828524] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be created. [ 593.839574] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.839574] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.839815] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.839997] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.840297] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.840594] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.937775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.937998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.938068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.938569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.938682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.964738] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-6ee26c59-2b39-40a5-b236-0c22105c5b40 tempest-ListServersNegativeTestJSON-719866848 tempest-ListServersNegativeTestJSON-719866848-project-member] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 593.964738] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 593.964738] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.965130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.965130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.965130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.965215] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.965300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.965300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.965300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.965300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.965300] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.006026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 594.186910] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: SUCCESS [ 594.187160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.187429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.187776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.188049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.188233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.188338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.188579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.188709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.188843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.188944] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.191131] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 676fe78e-8034-4a2e-ba53-7a214b3300d8 [ 594.191328] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.191449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.191934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.192045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.192141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.192242] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:676fe78e-8034-4a2e-ba53-7a214b3300d8 already deleted. [ 594.192329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-676fe78e-8034-4a2e-ba53-7a214b3300d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.470354] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.514880] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-a435210b-0f63-4b75-bb62-e0a798e1e33e service nova] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_rules [ 594.514880] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-a435210b-0f63-4b75-bb62-e0a798e1e33e service nova] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 594.514880] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-a435210b-0f63-4b75-bb62-e0a798e1e33e service nova] Enqueued Resource ID: 3609491e-6b56-4abd-85ea-870cf696133d with Priority: HIGHEST for action port [ 594.515173] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_rules [ 594.515301] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 594.515423] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3609491e-6b56-4abd-85ea-870cf696133d with Priority: HIGHEST for action port [ 594.516954] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.518672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.518672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.518672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.518672] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.518849] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.518902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.519587] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-3609491e-6b56-4abd-85ea-870cf696133d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.519587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.519587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.519587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.519587] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3609491e-6b56-4abd-85ea-870cf696133d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.530120] env[69274]: INFO networking_nsxv3.common.synchronization [None req-39139a43-e906-4053-a18b-28edfa74deff None None] Enqueued Resource ID: dd9597e5-961a-45fd-a92b-15f03093a5b0 with Priority: HIGHEST for action port [ 594.530297] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd9597e5-961a-45fd-a92b-15f03093a5b0 with Priority: HIGHEST for action port [ 594.531938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd9597e5-961a-45fd-a92b-15f03093a5b0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.531938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd9597e5-961a-45fd-a92b-15f03093a5b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.531938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd9597e5-961a-45fd-a92b-15f03093a5b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.531938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd9597e5-961a-45fd-a92b-15f03093a5b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.531938] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd9597e5-961a-45fd-a92b-15f03093a5b0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.695260] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.695260] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.695260] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.695260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.695677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.696144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.696144] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.696275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.696309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.696498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.696619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.696749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.696892] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.972362] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.026664] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.026877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.027215] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3609491e-6b56-4abd-85ea-870cf696133d with status ACTIVE [ 595.027372] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.027434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.027475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.028300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.028431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.028587] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.028860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.028860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.028917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.029237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.029237] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.029368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.029675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.029879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.029995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.030129] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3609491e-6b56-4abd-85ea-870cf696133d is going to be updated. [ 595.035066] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd9597e5-961a-45fd-a92b-15f03093a5b0 [ 595.036308] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.036417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.036487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.036896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.036896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.037017] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd9597e5-961a-45fd-a92b-15f03093a5b0 already deleted. [ 595.037075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd9597e5-961a-45fd-a92b-15f03093a5b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.055434] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.056091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.056255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.056525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.056734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.057110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3609491e-6b56-4abd-85ea-870cf696133d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.069225] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.069225] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.069225] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.069225] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.069225] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.069225] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.069225] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.069225] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.070356] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.070891] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.071857] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.072625] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.073075] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.078020] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.078020] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.078020] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.103194] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.103426] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 595.104167] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.104983] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-969" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.105564] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-8100332f-9272-4242-b5f4-9487fabfba68 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.108963] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.111024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.111024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.111024] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8100332f-9272-4242-b5f4-9487fabfba68',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.200025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2840b5fb-3a8f-4d93-a381-953dc8e31a67: rpc.has_security_group_logging(os_id): False [ 595.224033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.224033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.224033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.225602] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.225602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.225602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.225602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.225602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.225602] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.225602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.225602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.227114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.227371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.227528] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be created. [ 595.299789] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.300489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.300489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.300489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.301915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.324853] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: IN_PROGRESS for 2s [ 595.370840] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c in Status: SUCCESS [ 595.371112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.371637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.372310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.372310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.372310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.372310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.372654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.372698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.373053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.373053] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.477119] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.477561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.477561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.477561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.477695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.477695] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be created. [ 595.503810] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.503987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.504981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.504981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.504981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.514498] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: UNINITIALIZED for 2s [ 595.616232] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.616232] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 8100332f-9272-4242-b5f4-9487fabfba68 not found, creating... [ 595.616232] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.616232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.616617] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.616617] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.616617] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.616617] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.616617] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.616617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 8100332f-9272-4242-b5f4-9487fabfba68 is going to be created. [ 595.641616] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.641616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.641616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.641616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.641616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.641616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.876127] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5386bc-1dac-4dfb-a842-4c99e33f110c taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.876321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.876898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.876898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.876898] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.876898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.876898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.877118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.877159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.877332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.877399] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5386bc-1dac-4dfb-a842-4c99e33f110c taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.877461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.877491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.877632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.877752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.877865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.877906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.878069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.878183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.878294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.878355] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.931807] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-91fade7e-0925-410a-9258-93c8aa026902 service nova] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_rules [ 595.933467] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-91fade7e-0925-410a-9258-93c8aa026902 service nova] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 595.933467] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-91fade7e-0925-410a-9258-93c8aa026902 service nova] Enqueued Resource ID: 61689d60-1d3e-4a58-9e2b-eed68539431d with Priority: HIGHEST for action port [ 595.933467] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_rules [ 595.935056] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 595.935056] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61689d60-1d3e-4a58-9e2b-eed68539431d with Priority: HIGHEST for action port [ 595.938596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.938596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.938596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.938596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.938596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-61689d60-1d3e-4a58-9e2b-eed68539431d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.938596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.939085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.939085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.939085] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61689d60-1d3e-4a58-9e2b-eed68539431d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.025325] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 596.025325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.334361] env[69274]: INFO networking_nsxv3.common.synchronization [None req-077aa0ca-e500-47e7-9e1a-7b8adef5ace2 None None] Enqueued Resource ID: 03be4b9e-b177-4459-b789-7b48138c734a with Priority: HIGHEST for action port [ 596.334361] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03be4b9e-b177-4459-b789-7b48138c734a with Priority: HIGHEST for action port [ 596.334576] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-03be4b9e-b177-4459-b789-7b48138c734a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.334576] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03be4b9e-b177-4459-b789-7b48138c734a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.334685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03be4b9e-b177-4459-b789-7b48138c734a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.335021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03be4b9e-b177-4459-b789-7b48138c734a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.335021] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03be4b9e-b177-4459-b789-7b48138c734a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.383729] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf5386bc-1dac-4dfb-a842-4c99e33f110c: rpc.has_security_group_logging(os_id): False [ 596.403849] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.403849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.403849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.403849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.403849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.403849] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.403849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.403849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.404605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.404605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.404605] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.404605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.404605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.404605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.404605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.405043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.405043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.405043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.406473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.406473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.406473] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c is going to be created. [ 596.444249] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61689d60-1d3e-4a58-9e2b-eed68539431d with status ACTIVE [ 596.444249] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.444249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.444249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.444249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.444249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.444249] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.444249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.444651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.444651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.444651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.444735] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.444819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.445067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.445067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.445173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.445203] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61689d60-1d3e-4a58-9e2b-eed68539431d is going to be updated. [ 596.471255] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.471255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.471255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.471255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.471255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.471255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61689d60-1d3e-4a58-9e2b-eed68539431d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.497263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.497513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.497513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.499988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.499988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.511938] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c in Status: IN_PROGRESS for 2s [ 596.621313] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7445e2e9-4fb2-46b2-b60d-06f168b3a70f None None] Enqueued Resource ID: 57263690-133f-402e-a07a-d3a1b83bc3b3 with Priority: HIGHEST for action port [ 596.623843] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57263690-133f-402e-a07a-d3a1b83bc3b3 with Priority: HIGHEST for action port [ 596.625203] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-57263690-133f-402e-a07a-d3a1b83bc3b3 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.625343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57263690-133f-402e-a07a-d3a1b83bc3b3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.625343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57263690-133f-402e-a07a-d3a1b83bc3b3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.625664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57263690-133f-402e-a07a-d3a1b83bc3b3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.625664] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57263690-133f-402e-a07a-d3a1b83bc3b3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.837975] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03be4b9e-b177-4459-b789-7b48138c734a [ 596.838248] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.838395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.838468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.838689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.838782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.838881] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03be4b9e-b177-4459-b789-7b48138c734a already deleted. [ 596.838965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03be4b9e-b177-4459-b789-7b48138c734a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.867096] env[69274]: INFO networking_nsxv3.common.synchronization [req-caa81256-a2ac-40ba-a699-e9ce2e04a6ca req-e2be4f24-a22c-49ee-b877-dc210701f10d tempest-InstanceActionsTestJSON-180677158 tempest-InstanceActionsTestJSON-180677158-project-member] Enqueued Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_members [ 596.867735] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_members [ 596.868075] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.868706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.868784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.869100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.869715] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.869715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.869715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.869715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.869715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.869901] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.128982] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57263690-133f-402e-a07a-d3a1b83bc3b3 [ 597.128982] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.130785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.130785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.130785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.130785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.130785] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57263690-133f-402e-a07a-d3a1b83bc3b3 already deleted. [ 597.130785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57263690-133f-402e-a07a-d3a1b83bc3b3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.337698] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: SUCCESS [ 597.337941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.372770] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.372968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.373096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.373904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.373904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.373904] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.374074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.374074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.374213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.374312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.374388] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8017f169-c9ea-4513-9df7-442186576b39 already deleted. [ 597.374462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.526365] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 597.526613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.526788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.527016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.527206] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.527323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.527385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.528179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.528179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.528179] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.892474] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-655e2902-b7cc-4ccf-ad92-e381f5f9e388 service nova] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_rules [ 597.893010] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-655e2902-b7cc-4ccf-ad92-e381f5f9e388 service nova] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 597.893450] env[69274]: INFO networking_nsxv3.common.synchronization [req-d56e8cb7-5eba-455b-847e-5a0b8e062370 req-655e2902-b7cc-4ccf-ad92-e381f5f9e388 service nova] Enqueued Resource ID: 8100332f-9272-4242-b5f4-9487fabfba68 with Priority: HIGHEST for action port [ 597.894128] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_rules [ 597.894511] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 597.894760] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8100332f-9272-4242-b5f4-9487fabfba68 with Priority: HIGHEST for action port [ 597.895101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.895264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.895587] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.895768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.895994] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8100332f-9272-4242-b5f4-9487fabfba68 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.896158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.896346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.896607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.897358] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8100332f-9272-4242-b5f4-9487fabfba68',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.033033] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.401425] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8100332f-9272-4242-b5f4-9487fabfba68 with status ACTIVE [ 598.401927] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.402090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.402090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.402339] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.402432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.402623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.402717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.402778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.402962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.403052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.403375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.403375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.403375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.403710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.403710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.403710] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8100332f-9272-4242-b5f4-9487fabfba68 is going to be updated. [ 598.431583] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.436023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.436023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.436023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.436023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.436023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8100332f-9272-4242-b5f4-9487fabfba68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.538920] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c in Status: SUCCESS [ 598.538920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.538920] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.731028] env[69274]: INFO networking_nsxv3.common.synchronization [None req-0d886a4a-a94b-4c23-a38b-30f414d3b499 None None] Enqueued Resource ID: 81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2 with Priority: HIGHEST for action port [ 598.732150] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2 with Priority: HIGHEST for action port [ 598.733590] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.733799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.734028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.734363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.734444] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.044076] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.044076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.044076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.044338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.044338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.044461] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 599.092146] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.092146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.092146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.092146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.092146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.100447] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 599.237682] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2 [ 599.237855] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.237929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.237984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.238239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.238325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.238738] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2 already deleted. [ 599.238738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81bd2d22-8de2-4fdd-99fe-3f9dfd8d21d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.409931] env[69274]: INFO networking_nsxv3.common.synchronization [None req-a32ae0a6-11ce-4efc-8fb9-ebea7a3546b3 None None] Enqueued Resource ID: 5ab4c288-ab62-42ba-ab5a-4a01436d3b51 with Priority: HIGHEST for action port [ 599.410687] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ab4c288-ab62-42ba-ab5a-4a01436d3b51 with Priority: HIGHEST for action port [ 599.414660] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ab4c288-ab62-42ba-ab5a-4a01436d3b51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.414989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ab4c288-ab62-42ba-ab5a-4a01436d3b51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.414989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ab4c288-ab62-42ba-ab5a-4a01436d3b51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.416211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ab4c288-ab62-42ba-ab5a-4a01436d3b51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.416211] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ab4c288-ab62-42ba-ab5a-4a01436d3b51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.507773] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.507773] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-126" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.507773] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-126" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.508925] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-126" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.518274] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.518274] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.518274] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.518274] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.518274] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.518274] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.518274] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.518274] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.518274] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.518274] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.518274] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.518274] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.536747] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.536915] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 599.537063] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.537255] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-126" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.537701] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-f4340876-f054-49d5-a359-e02096fb4c11 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.537897] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.538027] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.539874] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.539874] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4340876-f054-49d5-a359-e02096fb4c11',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.798603] env[69274]: INFO networking_nsxv3.common.synchronization [None req-a08b16cf-1731-409f-8257-448d601fecce tempest-ServersWithSpecificFlavorTestJSON-7327972 tempest-ServersWithSpecificFlavorTestJSON-7327972-project-member] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 599.800908] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 599.800908] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.800908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.800908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.800908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.800908] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.918328] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ab4c288-ab62-42ba-ab5a-4a01436d3b51 [ 599.919387] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.919638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.919695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.920118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.920118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.920180] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ab4c288-ab62-42ba-ab5a-4a01436d3b51 already deleted. [ 599.920274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ab4c288-ab62-42ba-ab5a-4a01436d3b51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.044392] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.044392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.044392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.044392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.045208] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.045208] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port f4340876-f054-49d5-a359-e02096fb4c11 not found, creating... [ 600.045392] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.047016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.047016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.047016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.047016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.047016] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.047016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.047016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.047261] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.047291] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.047471] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: f4340876-f054-49d5-a359-e02096fb4c11 is going to be created. [ 600.072269] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.072685] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.072685] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.072934] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.074816] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.074816] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.241722] env[69274]: INFO networking_nsxv3.common.synchronization [None req-8f89224e-d3be-4e0b-8e22-f5fb6976a3a9 tempest-ServersWithSpecificFlavorTestJSON-7327972 tempest-ServersWithSpecificFlavorTestJSON-7327972-project-member] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 600.244257] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 600.244257] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.244257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.326310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.326484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.326553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.326742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.326942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.326942] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a already deleted. [ 600.327064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.328016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.328016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.328016] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.458708] env[69274]: INFO networking_nsxv3.common.synchronization [req-df4e06b0-4a0b-402c-97f2-6aa13720674b req-e87a1e9a-224b-4a23-950d-0cff74d87cea tempest-FloatingIPsAssociationTestJSON-1878357021 tempest-FloatingIPsAssociationTestJSON-1878357021-project-member] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 600.459971] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 600.459971] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.459971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.459971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.459971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.460356] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.460356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.460356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.460534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.460534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.460646] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.857475] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.858394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.858394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.858394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.858394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.858394] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a already deleted. [ 600.858394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.963364] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.963597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.963690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.964016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.964133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.964371] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.964834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.964834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.964834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.964834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.964984] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b already deleted. [ 600.964984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.029616] env[69274]: INFO networking_nsxv3.common.synchronization [None req-473cb6be-38ac-4609-85e5-4ea283d13b71 tempest-ServersTestFqdnHostnames-1855747695 tempest-ServersTestFqdnHostnames-1855747695-project-member] Enqueued Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_rules [ 601.029846] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_rules [ 601.030358] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.030594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.030672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.035291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.035291] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.113216] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 601.113582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.113811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.114061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.114572] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.115257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.117497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.117851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.117930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.118983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.118983] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.119632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.119843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.120071] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.120269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.120336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.120566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.120672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.120770] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.437044] env[69274]: INFO networking_nsxv3.common.synchronization [req-caa81256-a2ac-40ba-a699-e9ce2e04a6ca req-9547bcb1-5a58-4013-924a-3b03bffca180 service nova] Enqueued Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_rules [ 601.437678] env[69274]: INFO networking_nsxv3.common.synchronization [req-caa81256-a2ac-40ba-a699-e9ce2e04a6ca req-9547bcb1-5a58-4013-924a-3b03bffca180 service nova] Enqueued Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_members [ 601.437678] env[69274]: INFO networking_nsxv3.common.synchronization [req-caa81256-a2ac-40ba-a699-e9ce2e04a6ca req-9547bcb1-5a58-4013-924a-3b03bffca180 service nova] Enqueued Resource ID: f4340876-f054-49d5-a359-e02096fb4c11 with Priority: HIGHEST for action port [ 601.443020] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_rules [ 601.443020] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_members [ 601.443020] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4340876-f054-49d5-a359-e02096fb4c11 with Priority: HIGHEST for action port [ 601.443020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.443020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.443020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.443020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.443020] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.443498] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.443726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.443726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.443902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.446020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.446020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.446020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.446020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.446020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.446020] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.446832] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4340876-f054-49d5-a359-e02096fb4c11 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.446903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.446936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.447106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.447212] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4340876-f054-49d5-a359-e02096fb4c11',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.484288] env[69274]: INFO networking_nsxv3.common.synchronization [None req-cab5fbc3-2c9d-4402-a613-3ff25c530278 tempest-ServersTestFqdnHostnames-1855747695 tempest-ServersTestFqdnHostnames-1855747695-project-member] Enqueued Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_rules [ 601.485646] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_rules [ 601.485646] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.485646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.554627] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.557696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.557696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.557696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.557696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.557696] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b already deleted. [ 601.557696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.557696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.557696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.557696] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.562033] env[69274]: INFO networking_nsxv3.common.synchronization [None req-0a229e7a-399a-4c51-b73b-dea3d4f9d4a1 None None] Enqueued Resource ID: f86ef333-5619-4746-8c53-4414ea44ba30 with Priority: HIGHEST for action port [ 601.562033] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86ef333-5619-4746-8c53-4414ea44ba30 with Priority: HIGHEST for action port [ 601.562668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f86ef333-5619-4746-8c53-4414ea44ba30 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.562816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f86ef333-5619-4746-8c53-4414ea44ba30" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.562939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f86ef333-5619-4746-8c53-4414ea44ba30" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.565751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f86ef333-5619-4746-8c53-4414ea44ba30" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.565944] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f86ef333-5619-4746-8c53-4414ea44ba30',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.622668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.622839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.623583] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.950710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.950710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.950710] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.950710] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4340876-f054-49d5-a359-e02096fb4c11 with status ACTIVE [ 601.954900] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.955094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.955167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.955404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.955500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.955705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.955918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.955918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.956368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.957178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.957178] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.957178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.957178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.957178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.957178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.957476] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4340876-f054-49d5-a359-e02096fb4c11 is going to be updated. [ 601.982039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.982039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.982039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.982039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.982039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.982315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4340876-f054-49d5-a359-e02096fb4c11" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.071455] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f86ef333-5619-4746-8c53-4414ea44ba30 [ 602.071455] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.071455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.071455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.071455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.071455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.071455] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f86ef333-5619-4746-8c53-4414ea44ba30 already deleted. [ 602.071455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f86ef333-5619-4746-8c53-4414ea44ba30" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.091425] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.091425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.091425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.091425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.091425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.091425] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b already deleted. [ 602.091425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.126966] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.283932] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.283932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.283932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.283932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.283932] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.283932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.283932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.283932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.283932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.283932] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.283932] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.283932] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.283932] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.284837] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.284837] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.284837] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.314393] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.314944] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 602.315188] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.315359] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.315762] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-26ed9308-f51e-41ea-9165-bba631d37c0d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.315915] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.316042] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.316705] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.316705] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26ed9308-f51e-41ea-9165-bba631d37c0d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.462025] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.630783] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.631094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.631094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.631234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.631302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.631396] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 602.635935] env[69274]: INFO networking_nsxv3.common.synchronization [req-c105287d-24fb-41c0-a775-6b0b44526739 req-0fc140a2-9a54-4309-bb74-bf1a3b25378f tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 602.636608] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 602.638041] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.638041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.638041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.638041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.638301] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.638301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.638301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.638465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.638465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.638536] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.688232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.688232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.688232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.688232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.688232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.698466] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 602.820398] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.820629] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.820762] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.821081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.823182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.823182] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 26ed9308-f51e-41ea-9165-bba631d37c0d not found, creating... [ 602.823182] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.823182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.823182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.823182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.823182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.823182] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.823182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.823182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.827167] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.827456] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.827657] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 26ed9308-f51e-41ea-9165-bba631d37c0d is going to be created. [ 602.855444] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.855654] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.855780] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.856078] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.856302] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.858501] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.964902] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.965111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.965185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.965503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.965503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.965577] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8017f169-c9ea-4513-9df7-442186576b39 is going to be created. [ 603.008286] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.008429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.008492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.008710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.008864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.019261] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8017f169-c9ea-4513-9df7-442186576b39 in Status: UNINITIALIZED for 2s [ 603.105312] env[69274]: INFO networking_nsxv3.common.synchronization [None req-6d6ef6be-7b5e-49eb-a1a4-010a97eaa806 None None] Enqueued Resource ID: f86eb769-2682-4b62-95a1-5cb6531b9d5f with Priority: HIGHEST for action port [ 603.105312] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86eb769-2682-4b62-95a1-5cb6531b9d5f with Priority: HIGHEST for action port [ 603.105932] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f86eb769-2682-4b62-95a1-5cb6531b9d5f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.106171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f86eb769-2682-4b62-95a1-5cb6531b9d5f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.106171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f86eb769-2682-4b62-95a1-5cb6531b9d5f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.106391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f86eb769-2682-4b62-95a1-5cb6531b9d5f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.106493] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f86eb769-2682-4b62-95a1-5cb6531b9d5f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.144276] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.146471] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.146471] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f already deleted. [ 603.146471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.609829] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f86eb769-2682-4b62-95a1-5cb6531b9d5f [ 603.609955] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.610173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.610173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.610587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.610587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.610587] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f86eb769-2682-4b62-95a1-5cb6531b9d5f already deleted. [ 603.610707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f86eb769-2682-4b62-95a1-5cb6531b9d5f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.254309] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.254976] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.254976] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.255120] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.256195] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.256388] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.256497] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.257347] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.257683] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.258065] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.258285] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.258506] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.258650] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.258775] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.258998] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.259194] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.289014] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.289760] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 604.289760] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.289760] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.290086] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-08b9fb59-75fb-4301-bbcb-b162ee9cf551 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.290086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.290232] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.290624] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.290963] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b9fb59-75fb-4301-bbcb-b162ee9cf551',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.680226] env[69274]: INFO networking_nsxv3.common.synchronization [req-df4e06b0-4a0b-402c-97f2-6aa13720674b req-87408240-7936-4018-bf7b-63ec53e7889d service nova] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_rules [ 604.681081] env[69274]: INFO networking_nsxv3.common.synchronization [req-df4e06b0-4a0b-402c-97f2-6aa13720674b req-87408240-7936-4018-bf7b-63ec53e7889d service nova] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 604.681081] env[69274]: INFO networking_nsxv3.common.synchronization [req-df4e06b0-4a0b-402c-97f2-6aa13720674b req-87408240-7936-4018-bf7b-63ec53e7889d service nova] Enqueued Resource ID: 26ed9308-f51e-41ea-9165-bba631d37c0d with Priority: HIGHEST for action port [ 604.681269] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_rules [ 604.681407] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 604.682051] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed9308-f51e-41ea-9165-bba631d37c0d with Priority: HIGHEST for action port [ 604.682588] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.682751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.682867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.683649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.683649] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.684631] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.684631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.684631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.684631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.684778] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.684778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.684850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.684941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.685038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.685128] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.686090] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-26ed9308-f51e-41ea-9165-bba631d37c0d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.686298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.688805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.688996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.689090] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26ed9308-f51e-41ea-9165-bba631d37c0d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.710590] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 604.711948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.712118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.712803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.713012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.713385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.713385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.714154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.714154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.714154] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.795081] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.795421] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.795662] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.796515] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.797026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.797096] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 08b9fb59-75fb-4301-bbcb-b162ee9cf551 not found, creating... [ 604.797517] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.797791] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.798014] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.798476] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.798738] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.799282] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.800028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.800028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.800585] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.800671] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.800957] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 08b9fb59-75fb-4301-bbcb-b162ee9cf551 is going to be created. [ 604.826049] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.827964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.827964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.827964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.827964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.827964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.967132] env[69274]: INFO networking_nsxv3.common.synchronization [req-e03b8e1b-6e76-4b15-afc6-bc67ef9cb15e req-d497b464-7193-4565-b649-b784ac39703d tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 604.971032] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 604.971032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.971032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.971032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.971032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.971032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.971032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.971032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.971032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.971032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.971032] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.035196] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8017f169-c9ea-4513-9df7-442186576b39 in Status: SUCCESS [ 605.035196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.035196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.035196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.035538] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.035538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.035623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.035783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.035864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.035953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.036061] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.193584] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.193584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.193584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.193584] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26ed9308-f51e-41ea-9165-bba631d37c0d with status ACTIVE [ 605.193584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.193584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.193584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.193584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.193584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.193584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.193584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.193584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.195098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.195381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.195753] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.196157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.196387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.197316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.197595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.197842] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26ed9308-f51e-41ea-9165-bba631d37c0d is going to be updated. [ 605.216993] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.229853] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.230072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.230072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.230246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.230385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.230557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26ed9308-f51e-41ea-9165-bba631d37c0d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.472895] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.473192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.473192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.473361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.473552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.473652] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.473729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.473837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.473985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.474077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.474166] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f already deleted. [ 605.474244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.539752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.540018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.540139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.541228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.541334] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.541448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.541505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.541688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.541782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.541911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.542104] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.542227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.542451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.542451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.542584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.542682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.542743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.542911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.542980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.543415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.543521] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.702258] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.722733] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.996847] env[69274]: INFO networking_nsxv3.common.synchronization [None req-559cee4d-c066-4e6d-882a-b113b8cb4578 tempest-VolumesAssistedSnapshotsTest-309329079 tempest-VolumesAssistedSnapshotsTest-309329079-project-member] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_rules [ 605.996847] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_rules [ 605.996847] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.996847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.996847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.997246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.997850] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.048237] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8017f169-c9ea-4513-9df7-442186576b39: rpc.has_security_group_logging(os_id): False [ 606.068836] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.068997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.069082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.069297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.069391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.069739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.069895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.069895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.070042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.070122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.070331] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.070435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.070561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.070730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.071617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.071932] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.072214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.072309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.072484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.072589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.072701] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8017f169-c9ea-4513-9df7-442186576b39 is going to be created. [ 606.135281] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.135598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.135598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.135743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.136717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.149806] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8017f169-c9ea-4513-9df7-442186576b39 in Status: IN_PROGRESS for 2s [ 606.207115] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.207297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.208136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.208136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.208136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.208136] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be created. [ 606.224159] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.224476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.224476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.224759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.224838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.228026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 606.288477] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.288695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.288762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.288948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.289136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.304798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: UNINITIALIZED for 2s [ 606.305527] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.305665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.305774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.306088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.306231] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.315799] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 606.474037] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3efecc12-998a-4640-9fbd-d2eb8d9b8b84 tempest-VolumesAssistedSnapshotsTest-309329079 tempest-VolumesAssistedSnapshotsTest-309329079-project-member] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_rules [ 606.476792] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_rules [ 606.478051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.478190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.520480] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.520687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.520760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.520978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.521384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.521460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 already deleted. [ 606.521506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.521668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.521840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.521942] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.753563] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.753563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.753563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.753563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.753563] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.753563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.753563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.753563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.753563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.753563] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.753563] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.753563] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.753563] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.754080] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.754080] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.754080] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.774823] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.774823] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 606.774972] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.775025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.775349] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fc723afe-f57e-4df5-b0b2-d430bb692450 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.775633] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.775712] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.776194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.776333] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc723afe-f57e-4df5-b0b2-d430bb692450',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.798738] env[69274]: INFO networking_nsxv3.common.synchronization [None req-1ae84163-9d36-4612-a133-dfeef68a0477 None None] Enqueued Resource ID: 5bf272c0-6d5f-47e3-b455-885d59fc3542 with Priority: HIGHEST for action port [ 606.799288] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf272c0-6d5f-47e3-b455-885d59fc3542 with Priority: HIGHEST for action port [ 606.799912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bf272c0-6d5f-47e3-b455-885d59fc3542 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.800165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bf272c0-6d5f-47e3-b455-885d59fc3542" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.800280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bf272c0-6d5f-47e3-b455-885d59fc3542" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.800598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bf272c0-6d5f-47e3-b455-885d59fc3542" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.800795] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf272c0-6d5f-47e3-b455-885d59fc3542',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.879280] env[69274]: INFO networking_nsxv3.common.synchronization [req-c105287d-24fb-41c0-a775-6b0b44526739 req-68edeab7-6884-4670-8eb8-ad269012f90c service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 606.879280] env[69274]: INFO networking_nsxv3.common.synchronization [req-c105287d-24fb-41c0-a775-6b0b44526739 req-68edeab7-6884-4670-8eb8-ad269012f90c service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 606.879280] env[69274]: INFO networking_nsxv3.common.synchronization [req-c105287d-24fb-41c0-a775-6b0b44526739 req-68edeab7-6884-4670-8eb8-ad269012f90c service nova] Enqueued Resource ID: 08b9fb59-75fb-4301-bbcb-b162ee9cf551 with Priority: HIGHEST for action port [ 606.879280] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 606.879280] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 606.879280] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b9fb59-75fb-4301-bbcb-b162ee9cf551 with Priority: HIGHEST for action port [ 606.879884] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.879884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.879884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.879884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.880143] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.882805] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.883181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.883181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.883287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.883498] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.889024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.889024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.889024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.889024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.889024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.889024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-08b9fb59-75fb-4301-bbcb-b162ee9cf551 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.889266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.889266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.889332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.889913] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b9fb59-75fb-4301-bbcb-b162ee9cf551',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.057104] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.057495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.057587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.060279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.060279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.060279] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 already deleted. [ 607.060279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.282583] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.283029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.283189] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.283668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.283771] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.283858] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port fc723afe-f57e-4df5-b0b2-d430bb692450 not found, creating... [ 607.284750] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.284750] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.284750] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.284750] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.285028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.286721] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.287015] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.287162] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.287566] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.287692] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.287882] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fc723afe-f57e-4df5-b0b2-d430bb692450 is going to be created. [ 607.306500] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bf272c0-6d5f-47e3-b455-885d59fc3542 [ 607.306802] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.306963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.307062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.307304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.307402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.307531] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bf272c0-6d5f-47e3-b455-885d59fc3542 already deleted. [ 607.307621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bf272c0-6d5f-47e3-b455-885d59fc3542" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.324528] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.324528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.324528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.324528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.324528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.324528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.392894] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.394559] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.394699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.396369] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08b9fb59-75fb-4301-bbcb-b162ee9cf551 with status ACTIVE [ 607.396369] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.396369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.396369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.396369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.396369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.396826] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.396951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.397032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.397278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.397367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.397759] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.397912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.397981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.398187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.398267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.398372] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08b9fb59-75fb-4301-bbcb-b162ee9cf551 is going to be updated. [ 607.451235] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.451235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.451235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.451235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.451235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.451235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08b9fb59-75fb-4301-bbcb-b162ee9cf551" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.896444] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.163831] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8017f169-c9ea-4513-9df7-442186576b39 in Status: SUCCESS [ 608.164079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.171507] env[69274]: INFO networking_nsxv3.common.synchronization [None req-db51106c-0d5f-4364-a63b-2033d62db350 None None] Enqueued Resource ID: 430df9ba-2169-48ec-be12-e67fa5ba0c79 with Priority: HIGHEST for action port [ 608.172082] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 430df9ba-2169-48ec-be12-e67fa5ba0c79 with Priority: HIGHEST for action port [ 608.172439] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-430df9ba-2169-48ec-be12-e67fa5ba0c79 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.172570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-430df9ba-2169-48ec-be12-e67fa5ba0c79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.172657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-430df9ba-2169-48ec-be12-e67fa5ba0c79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.172940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-430df9ba-2169-48ec-be12-e67fa5ba0c79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.174570] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('430df9ba-2169-48ec-be12-e67fa5ba0c79',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.317089] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: SUCCESS [ 608.317146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.318842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.318842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.318842] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.319045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.319045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.319256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.319324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.319433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.319667] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.329599] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.329599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.329599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.329599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.330063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.330063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.330199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.330244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.330506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.330699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.330785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.330871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.330966] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.401641] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.401814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.401890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.402136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.402234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.402335] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be created. [ 608.428449] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.428449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.428449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.428449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.429716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.443372] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: UNINITIALIZED for 2s [ 608.492024] env[69274]: INFO networking_nsxv3.common.synchronization [None req-970b0b42-8d9f-4f60-836b-5ba1aa27222a None None] Enqueued Resource ID: 895276be-4e67-4bc8-af1b-69c4f45b69a2 with Priority: HIGHEST for action port [ 608.492024] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 895276be-4e67-4bc8-af1b-69c4f45b69a2 with Priority: HIGHEST for action port [ 608.492024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-895276be-4e67-4bc8-af1b-69c4f45b69a2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.492024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-895276be-4e67-4bc8-af1b-69c4f45b69a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.492024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-895276be-4e67-4bc8-af1b-69c4f45b69a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.492024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-895276be-4e67-4bc8-af1b-69c4f45b69a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.492024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895276be-4e67-4bc8-af1b-69c4f45b69a2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.678070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 430df9ba-2169-48ec-be12-e67fa5ba0c79 [ 608.680054] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.680054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.680054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.680054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.680054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.680054] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:430df9ba-2169-48ec-be12-e67fa5ba0c79 already deleted. [ 608.680054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-430df9ba-2169-48ec-be12-e67fa5ba0c79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.823178] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.823554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.825499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.825499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.825499] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.825499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.825499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.825499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.825499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.825499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.827314] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.827314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.827314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.827314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.827314] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.827314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.827314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.827314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.827764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.827884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.828124] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.835971] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a499f7e4-147f-443a-94fe-27f18e7a8418: rpc.has_security_group_logging(os_id): False [ 608.856574] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.856811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.856929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.857270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.857421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.857765] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.857929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.858883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.859138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.859321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.859423] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.859526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.859744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.859981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.860082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.860296] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.860390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.860453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.860611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.860685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.860771] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be created. [ 608.950013] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.951220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.951308] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.952185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.952185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.958692] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b7170f55-1f92-483d-a895-ca29389cf915 None None] Enqueued Resource ID: f887d6e8-4296-44c4-bb68-7971be23489a with Priority: HIGHEST for action port [ 608.958692] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f887d6e8-4296-44c4-bb68-7971be23489a with Priority: HIGHEST for action port [ 608.958692] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f887d6e8-4296-44c4-bb68-7971be23489a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.958692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f887d6e8-4296-44c4-bb68-7971be23489a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.958692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f887d6e8-4296-44c4-bb68-7971be23489a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.960765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f887d6e8-4296-44c4-bb68-7971be23489a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.960765] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f887d6e8-4296-44c4-bb68-7971be23489a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.971443] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 608.994872] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 895276be-4e67-4bc8-af1b-69c4f45b69a2 [ 608.994872] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.995102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.995102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.996034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.996034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.996034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:895276be-4e67-4bc8-af1b-69c4f45b69a2 already deleted. [ 608.996034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-895276be-4e67-4bc8-af1b-69c4f45b69a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.285680] env[69274]: INFO networking_nsxv3.common.synchronization [req-e03b8e1b-6e76-4b15-afc6-bc67ef9cb15e req-d183e6f7-bac5-4b7b-a6b0-e0508da893fc service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 609.290031] env[69274]: INFO networking_nsxv3.common.synchronization [req-e03b8e1b-6e76-4b15-afc6-bc67ef9cb15e req-d183e6f7-bac5-4b7b-a6b0-e0508da893fc service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 609.290031] env[69274]: INFO networking_nsxv3.common.synchronization [req-e03b8e1b-6e76-4b15-afc6-bc67ef9cb15e req-d183e6f7-bac5-4b7b-a6b0-e0508da893fc service nova] Enqueued Resource ID: fc723afe-f57e-4df5-b0b2-d430bb692450 with Priority: HIGHEST for action port [ 609.290031] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 609.290031] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 609.290031] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc723afe-f57e-4df5-b0b2-d430bb692450 with Priority: HIGHEST for action port [ 609.290031] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.290031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.290031] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.290031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.290031] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc723afe-f57e-4df5-b0b2-d430bb692450 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.290031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.290031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.290031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.290031] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc723afe-f57e-4df5-b0b2-d430bb692450',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.336477] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f154d6-8c77-4554-a90c-034e9602b91b: rpc.has_security_group_logging(os_id): False [ 609.361720] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.361984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.361984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.362186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.362264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.362462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.362584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.362645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.362763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.362845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.363038] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.363132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.363188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.363358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.363437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.363587] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.363683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.363744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.363880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.363934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.364025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be created. [ 609.367939] env[69274]: INFO networking_nsxv3.common.synchronization [req-2af01341-a51a-4d73-9776-2c1fc3df08c4 req-78f2fb01-cecf-464b-896e-c2eed5cbf54c tempest-DeleteServersAdminTestJSON-2035177167 tempest-DeleteServersAdminTestJSON-2035177167-project-admin] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 609.368561] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 609.370802] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.370802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.370802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.370802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.370802] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.370802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.370802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.370802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.370802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.370802] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.436725] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.436725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.437019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.437081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.437656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.453270] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: IN_PROGRESS for 2s [ 609.466199] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f887d6e8-4296-44c4-bb68-7971be23489a [ 609.466493] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.466638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.466711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.466935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.467048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.467151] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f887d6e8-4296-44c4-bb68-7971be23489a already deleted. [ 609.467237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f887d6e8-4296-44c4-bb68-7971be23489a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.794250] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc723afe-f57e-4df5-b0b2-d430bb692450 with status ACTIVE [ 609.794414] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.794820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.794820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.795430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.795430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.797106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.797248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.797248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.797932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.797932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.797932] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.797932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.798220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.798220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.799332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.799468] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc723afe-f57e-4df5-b0b2-d430bb692450 is going to be updated. [ 609.831680] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.831775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.831827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.832137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.834352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.834352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc723afe-f57e-4df5-b0b2-d430bb692450" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.876599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.876599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.876599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.876599] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be updated. [ 609.926543] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.926543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.926543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.926543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.926543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.937152] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: IN_PROGRESS for 2s [ 610.208895] env[69274]: INFO networking_nsxv3.common.synchronization [None req-d25b2c94-66d1-4db7-8c7c-e8e2229099ae None None] Enqueued Resource ID: 678b87c0-aa75-4767-af19-f28d3905821e with Priority: HIGHEST for action port [ 610.209516] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 678b87c0-aa75-4767-af19-f28d3905821e with Priority: HIGHEST for action port [ 610.209867] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-678b87c0-aa75-4767-af19-f28d3905821e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.209998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-678b87c0-aa75-4767-af19-f28d3905821e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.211492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-678b87c0-aa75-4767-af19-f28d3905821e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.214239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-678b87c0-aa75-4767-af19-f28d3905821e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.214239] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('678b87c0-aa75-4767-af19-f28d3905821e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.312289] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b127e8b9-e0ce-4e1b-ad22-b5675fee9e93 None None] Enqueued Resource ID: c5e2321c-671b-46ec-ab88-6dddb59b9507 with Priority: HIGHEST for action port [ 610.313144] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e2321c-671b-46ec-ab88-6dddb59b9507 with Priority: HIGHEST for action port [ 610.313545] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5e2321c-671b-46ec-ab88-6dddb59b9507 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.313681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5e2321c-671b-46ec-ab88-6dddb59b9507" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.313761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5e2321c-671b-46ec-ab88-6dddb59b9507" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.314311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5e2321c-671b-46ec-ab88-6dddb59b9507" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.314456] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e2321c-671b-46ec-ab88-6dddb59b9507',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.454545] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 610.454761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.454926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.455482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.455482] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.455482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.455638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.455755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.455872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.456044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.456109] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.457587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.457587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.457891] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.458044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.458137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.458315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.458424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.458530] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.718682] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 678b87c0-aa75-4767-af19-f28d3905821e [ 610.719250] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.719250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.722874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.722874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.722874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.722874] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:678b87c0-aa75-4767-af19-f28d3905821e already deleted. [ 610.722874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-678b87c0-aa75-4767-af19-f28d3905821e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.818408] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5e2321c-671b-46ec-ab88-6dddb59b9507 [ 610.818630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.818794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.818887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.819121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.819121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.819121] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5e2321c-671b-46ec-ab88-6dddb59b9507 already deleted. [ 610.819121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5e2321c-671b-46ec-ab88-6dddb59b9507" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.960281] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.961097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.961097] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.986655] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 610.986894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.987100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.987316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.987403] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.339196] env[69274]: INFO networking_nsxv3.common.synchronization [None req-71bd7504-e44b-46f7-9ea3-b9214945c945 tempest-ServerActionsV293TestJSON-1995669322 tempest-ServerActionsV293TestJSON-1995669322-project-member] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_rules [ 611.339861] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_rules [ 611.341043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.341182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.342136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.342587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.342863] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.464738] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.473023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: SUCCESS [ 611.473023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.492447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.495095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.495218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.495494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.495732] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.496344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.496344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.496344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.496344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.496478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.496520] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.624301] env[69274]: INFO networking_nsxv3.common.synchronization [None req-f085efdc-33ab-469f-8b8a-41156e82edd2 tempest-ServerActionsV293TestJSON-1995669322 tempest-ServerActionsV293TestJSON-1995669322-project-member] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_rules [ 611.624922] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_rules [ 611.625263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.625374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.881032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.881032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.881032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.881032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.881032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.881032] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a already deleted. [ 611.881032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.881032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.882672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.882816] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.952255] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: SUCCESS [ 611.952904] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 deletion is rescheduled due to dependency. [ 611.952904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.967352] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.968198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.968304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.968582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.968706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.968800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 611.982017] env[69274]: INFO networking_nsxv3.common.synchronization [None req-c2c95281-7646-4eb8-a9ab-701b16d3fb40 None None] Enqueued Resource ID: 8f7336bc-6a84-4eb0-bbae-586304590cab with Priority: HIGHEST for action port [ 611.982752] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7336bc-6a84-4eb0-bbae-586304590cab with Priority: HIGHEST for action port [ 611.983345] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f7336bc-6a84-4eb0-bbae-586304590cab taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.983484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f7336bc-6a84-4eb0-bbae-586304590cab" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.983567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f7336bc-6a84-4eb0-bbae-586304590cab" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.983849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f7336bc-6a84-4eb0-bbae-586304590cab" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.983956] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f7336bc-6a84-4eb0-bbae-586304590cab',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.000415] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.001225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.001225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.001225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.001225] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.001225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.001416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.001580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.001739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.001930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.002132] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.002243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.002338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.002540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.006044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.006044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.006044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.006044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.006044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.006044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.006044] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.028033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.030216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.030216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.030216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.030216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.033273] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7e252b29-a54d-4794-968d-7488c99046e8 None None] Enqueued Resource ID: c5b904c9-6bb7-423c-a5ca-210e42dd1f29 with Priority: HIGHEST for action port [ 612.035630] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5b904c9-6bb7-423c-a5ca-210e42dd1f29 with Priority: HIGHEST for action port [ 612.036765] env[69274]: INFO networking_nsxv3.common.synchronization [req-25f847f1-7303-4215-b25a-90aa871ceacd req-31617113-a06d-4d3b-b402-70a1fb1ceba8 tempest-VolumesAdminNegativeTest-289876529 tempest-VolumesAdminNegativeTest-289876529-project-member] Enqueued Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_members [ 612.038131] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5b904c9-6bb7-423c-a5ca-210e42dd1f29 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.038131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5b904c9-6bb7-423c-a5ca-210e42dd1f29" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.038131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5b904c9-6bb7-423c-a5ca-210e42dd1f29" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.038131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5b904c9-6bb7-423c-a5ca-210e42dd1f29" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.038131] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5b904c9-6bb7-423c-a5ca-210e42dd1f29',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.039413] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_members [ 612.040905] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.041345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.041519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.041914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.042432] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.043841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.043841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.043841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.043841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.043841] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.140086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 612.406765] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.407241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.407241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.407241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.407828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.407828] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a already deleted. [ 612.407828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.487134] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f7336bc-6a84-4eb0-bbae-586304590cab [ 612.487451] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.487538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.487666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.487900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.488426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.488426] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f7336bc-6a84-4eb0-bbae-586304590cab already deleted. [ 612.488426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f7336bc-6a84-4eb0-bbae-586304590cab" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.506898] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a499f7e4-147f-443a-94fe-27f18e7a8418: rpc.has_security_group_logging(os_id): False [ 612.540849] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.540849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.540849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.540849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.540849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.540849] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.540849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.540849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.540849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.541271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.545322] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.545604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.545713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.546202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.546202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.546594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.546774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.546877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.547145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.547282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.547528] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 612.549366] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5b904c9-6bb7-423c-a5ca-210e42dd1f29 [ 612.549650] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.549828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.550019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.550223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.550358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.550497] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5b904c9-6bb7-423c-a5ca-210e42dd1f29 already deleted. [ 612.550723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5b904c9-6bb7-423c-a5ca-210e42dd1f29" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.551046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.552076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.552076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.552076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.552076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.552076] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.552261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.552293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.552518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.552633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.552763] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 already deleted. [ 612.552893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.673409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.673409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.673645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.674084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.674149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.689777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 612.927713] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.927713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.927713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.927884] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.929852] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.933444] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.933707] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.934092] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.934350] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.934660] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 612.934875] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.935101] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.935298] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.935457] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 612.935575] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.935748] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.959346] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.959860] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 612.960087] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.960377] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.960597] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.960807] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.961254] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.962371] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.962560] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75b052b0-dcc0-4297-bc30-1b7d5b7320e4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.464842] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.467247] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 75b052b0-dcc0-4297-bc30-1b7d5b7320e4 not found, creating... [ 613.467247] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.467247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.467609] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.467609] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.467720] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.467982] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.471292] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.471550] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 75b052b0-dcc0-4297-bc30-1b7d5b7320e4 is going to be created. [ 613.482486] env[69274]: INFO networking_nsxv3.common.synchronization [None req-9d901395-468b-4ee6-8840-b54367e548cf None None] Enqueued Resource ID: ce3eb114-3458-4cdd-b672-7b37ef110f8f with Priority: HIGHEST for action port [ 613.482486] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce3eb114-3458-4cdd-b672-7b37ef110f8f with Priority: HIGHEST for action port [ 613.482486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce3eb114-3458-4cdd-b672-7b37ef110f8f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.482486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce3eb114-3458-4cdd-b672-7b37ef110f8f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.482486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce3eb114-3458-4cdd-b672-7b37ef110f8f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.482486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce3eb114-3458-4cdd-b672-7b37ef110f8f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.485389] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce3eb114-3458-4cdd-b672-7b37ef110f8f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.494753] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.498501] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.498718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.499117] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.499382] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.499679] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.992562] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce3eb114-3458-4cdd-b672-7b37ef110f8f [ 613.993199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.993346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.993444] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.993937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.993937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.995498] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce3eb114-3458-4cdd-b672-7b37ef110f8f already deleted. [ 613.995699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce3eb114-3458-4cdd-b672-7b37ef110f8f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.152961] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 614.153612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.157143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.157143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.157143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.157143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.161602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.161826] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.440301] env[69274]: INFO networking_nsxv3.common.synchronization [req-7f1126c9-8e94-4c3f-9bfc-1f550fcdd253 req-f3124932-69d3-47db-be38-42175820f500 tempest-TenantUsagesTestJSON-287331542 tempest-TenantUsagesTestJSON-287331542-project-member] Enqueued Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_members [ 614.441792] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c with Priority: HIGHEST for action security_group_members [ 614.441792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf5386bc-1dac-4dfb-a842-4c99e33f110c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.441792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.441792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.441792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.442529] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.442529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.442688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.442799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.442903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.443215] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf5386bc-1dac-4dfb-a842-4c99e33f110c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.663615] env[69274]: INFO networking_nsxv3.common.synchronization [req-91146c33-39f9-4fc2-89c1-218c695a6117 req-22f3dd67-9725-49bd-ba44-c2f532939ec1 tempest-ServerDiagnosticsNegativeTest-323261654 tempest-ServerDiagnosticsNegativeTest-323261654-project-member] Enqueued Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_members [ 614.663615] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_members [ 614.664118] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.664118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.664118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.664451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.664498] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.664605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.664647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.664794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.664880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.664982] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.666319] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f: rpc.has_security_group_logging(os_id): False [ 614.688241] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.688389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.688466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.688698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.688794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.688998] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.689113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.689177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.689887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.689887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.689887] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.689887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.689887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.690125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.690125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.690298] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.690347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.691049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.691049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.691049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.691049] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be created. [ 614.711276] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 614.711723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.711813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.715068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.715068] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.763417] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.763738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.763912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.765599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.765599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.777323] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 614.793349] env[69274]: INFO networking_nsxv3.common.synchronization [req-25f847f1-7303-4215-b25a-90aa871ceacd req-136f9e69-16b5-4de1-9f11-1595d320714a service nova] Enqueued Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_rules [ 614.793611] env[69274]: INFO networking_nsxv3.common.synchronization [req-25f847f1-7303-4215-b25a-90aa871ceacd req-136f9e69-16b5-4de1-9f11-1595d320714a service nova] Enqueued Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_members [ 614.793900] env[69274]: INFO networking_nsxv3.common.synchronization [req-25f847f1-7303-4215-b25a-90aa871ceacd req-136f9e69-16b5-4de1-9f11-1595d320714a service nova] Enqueued Resource ID: 75b052b0-dcc0-4297-bc30-1b7d5b7320e4 with Priority: HIGHEST for action port [ 614.797160] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_rules [ 614.798497] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_members [ 614.798690] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b052b0-dcc0-4297-bc30-1b7d5b7320e4 with Priority: HIGHEST for action port [ 614.799547] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.801883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.802014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.802290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.802405] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.803593] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.803817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.803817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.805175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.805418] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.805607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.805710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.806033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.806162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.807068] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.808915] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.810256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.810380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.810635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.811235] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75b052b0-dcc0-4297-bc30-1b7d5b7320e4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.946076] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.946272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.946354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.946815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.946957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.947181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.947295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.947382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.947577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.947674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.947782] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c is going to be updated. [ 614.983233] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.983373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.983448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.983682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.983826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.999087] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c in Status: IN_PROGRESS for 2s [ 615.168784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.169102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.169175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.169411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.169485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.169986] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.170219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.170330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.170702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.170907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.171064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc14d56-7e2f-4186-9451-37adac5c5b23 already deleted. [ 615.171717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.211455] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.211699] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.211828] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.212153] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.212423] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.212582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.212722] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.213293] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.213732] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.214016] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 615.214556] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.214556] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.214556] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.214556] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 615.214743] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.214795] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.218391] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.222053] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.222053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.222053] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.251561] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.251561] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 615.252660] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.252660] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.252660] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-f0a35821-b5f2-47f2-b9af-188f9a802822 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.252660] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.252660] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.252895] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.252895] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a35821-b5f2-47f2-b9af-188f9a802822',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.313395] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.314428] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.314553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.316227] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75b052b0-dcc0-4297-bc30-1b7d5b7320e4 with status ACTIVE [ 615.316400] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.316551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.316651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.316823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.316930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.317126] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.317227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.317297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.317613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.317613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.319318] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.319318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.319318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.319318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.319318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.319318] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75b052b0-dcc0-4297-bc30-1b7d5b7320e4 is going to be updated. [ 615.345839] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.346063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.346161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.346471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.347078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.347078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75b052b0-dcc0-4297-bc30-1b7d5b7320e4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.729048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.729048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.729048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.729048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.729048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.730689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.730689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.730689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.730689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.730689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.730689] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.756103] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.756351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.756626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.757964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.757964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.757964] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port f0a35821-b5f2-47f2-b9af-188f9a802822 not found, creating... [ 615.758321] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.758420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.758586] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.759080] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.762038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.762038] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.762038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.762038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.762038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.762038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.762038] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: f0a35821-b5f2-47f2-b9af-188f9a802822 is going to be created. [ 615.808131] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.808479] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.808687] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.809206] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.810643] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.810643] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.816429] env[69274]: INFO networking_nsxv3.common.synchronization [req-b6b83186-9beb-462b-97d9-33dc679f9c2e req-605679db-b0bb-4440-a74e-48e8b6262ea2 tempest-ListServersNegativeTestJSON-719866848 tempest-ListServersNegativeTestJSON-719866848-project-member] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 615.817703] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.821741] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 615.823251] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.823251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.823251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.823251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.823942] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.823942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.823942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.824063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.824238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.824314] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.232990] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a499f7e4-147f-443a-94fe-27f18e7a8418: rpc.has_security_group_logging(os_id): False [ 616.255258] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.255647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.255861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.256189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.256409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.256766] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.256943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.257064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.257562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.257562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.258727] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.258727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.258727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.258727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.258727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.259043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.259310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.259390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.259608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.259822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.259964] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 616.321379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.322146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.322322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.322624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.322737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.322849] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 is going to be created. [ 616.329571] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.338508] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.338508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.338508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.338508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.338736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.352697] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.352697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.352995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.352995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.353120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.356347] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 616.366111] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 in Status: UNINITIALIZED for 2s [ 616.789509] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 616.789999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.790088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.790383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.790491] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.832716] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.016938] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c in Status: SUCCESS [ 617.016938] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf5386bc-1dac-4dfb-a842-4c99e33f110c deletion is rescheduled due to dependency. [ 617.016938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf5386bc-1dac-4dfb-a842-4c99e33f110c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.229569] env[69274]: INFO networking_nsxv3.common.synchronization [req-91146c33-39f9-4fc2-89c1-218c695a6117 req-8111da4a-3dfb-482e-aaaa-7d7442137665 service nova] Enqueued Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_rules [ 617.229801] env[69274]: INFO networking_nsxv3.common.synchronization [req-91146c33-39f9-4fc2-89c1-218c695a6117 req-8111da4a-3dfb-482e-aaaa-7d7442137665 service nova] Enqueued Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_members [ 617.229966] env[69274]: INFO networking_nsxv3.common.synchronization [req-91146c33-39f9-4fc2-89c1-218c695a6117 req-8111da4a-3dfb-482e-aaaa-7d7442137665 service nova] Enqueued Resource ID: f0a35821-b5f2-47f2-b9af-188f9a802822 with Priority: HIGHEST for action port [ 617.230533] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_rules [ 617.230686] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_members [ 617.231646] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0a35821-b5f2-47f2-b9af-188f9a802822 with Priority: HIGHEST for action port [ 617.232151] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.232277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.232277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.232580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.233307] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.235224] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.235224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.236189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.236189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.236189] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.237330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.237330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.237330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.237330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.237330] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.237654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0a35821-b5f2-47f2-b9af-188f9a802822 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.238365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.238467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.238652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.238779] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a35821-b5f2-47f2-b9af-188f9a802822',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.294204] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.294461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.294461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.294680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.294846] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.294965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.295037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.295182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.295269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.295361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.295454] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.335361] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.335568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.335664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.335962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.336129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.336272] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 617.380988] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.382622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.382747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.383055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.384607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.399820] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 617.523317] env[69274]: INFO networking_nsxv3.common.synchronization [req-3420370c-866a-4334-a92c-d86980400555 req-0d82b50a-640c-4b42-a772-227c96c03df1 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 617.523317] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 617.523317] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.523461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.523494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.523874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.523933] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.523991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.527025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.527025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.527025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.527025] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.741195] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.742489] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.742703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.743100] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0a35821-b5f2-47f2-b9af-188f9a802822 with status ACTIVE [ 617.743100] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.743301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.743301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.743522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.743774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.743890] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.744046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.744125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.744303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.744376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.744701] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.744826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.744826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.744979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.745089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.745239] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0a35821-b5f2-47f2-b9af-188f9a802822 is going to be updated. [ 617.782767] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.783010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.783131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.783366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.784210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.784210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0a35821-b5f2-47f2-b9af-188f9a802822" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.802622] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.802622] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.802622] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.802622] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.802622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.803387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.803387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.803387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.803387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.803387] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.029261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.029457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.029517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.029773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.029905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.030093] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.030213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.030275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.030436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.030797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.030797] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 already deleted. [ 618.030797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.247889] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.304995] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f: rpc.has_security_group_logging(os_id): False [ 618.328972] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.328972] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.328972] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.328972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.329963] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.329963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.329963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.329963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.329963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.329963] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 618.372703] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 618.372943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.390918] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 in Status: SUCCESS [ 618.391257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.391532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.391816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.392102] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.392270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.392360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.392588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.392815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.392895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.392982] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.396463] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.396640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.397397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.397397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.397397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.417344] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 618.612869] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.613094] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.613214] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.613557] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.613827] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.613993] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.614622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.614977] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.615090] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.615356] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.615473] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.615588] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.615731] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.615854] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.615966] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.616114] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.635116] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.635291] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 618.635436] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.635632] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.635984] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d04e31bf-cc32-4453-8b4a-5169d1a4d635 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.636313] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.636475] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.639596] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.639596] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04e31bf-cc32-4453-8b4a-5169d1a4d635',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.750473] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.750627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.751013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.751013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.751112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.751177] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc14d56-7e2f-4186-9451-37adac5c5b23 is going to be created. [ 618.776640] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.776640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.776640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.776640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.776640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.791799] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc14d56-7e2f-4186-9451-37adac5c5b23 in Status: UNINITIALIZED for 2s [ 618.897307] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.139431] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.139663] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.139864] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.140185] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.140338] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.140586] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port d04e31bf-cc32-4453-8b4a-5169d1a4d635 not found, creating... [ 619.140900] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.141087] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.141204] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.141435] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.141573] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.141857] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.142085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.142164] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.142371] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.142502] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.142652] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d04e31bf-cc32-4453-8b4a-5169d1a4d635 is going to be created. [ 619.165433] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.165677] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.165857] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.166064] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.166298] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.166532] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.402647] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5cb0145-b4ca-4858-acad-7f67f4ef4d84: rpc.has_security_group_logging(os_id): False [ 619.411782] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 619.411782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.425025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.425025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.425025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.425025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 is going to be created. [ 619.492229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.492388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.493697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.493697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.493697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.507500] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 in Status: IN_PROGRESS for 2s [ 619.718867] env[69274]: INFO networking_nsxv3.common.synchronization [req-7810e047-b9f2-401d-ad01-38b0508b6bf6 req-1a8ec515-2338-46d2-b1f3-2b3b176315eb tempest-ServerPasswordTestJSON-1705473031 tempest-ServerPasswordTestJSON-1705473031-project-member] Enqueued Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_members [ 619.719601] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_members [ 619.719710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.719887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.719958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.721240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.721459] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.722047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.722047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.722047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.722047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.722047] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.955874] env[69274]: INFO networking_nsxv3.common.synchronization [req-3420370c-866a-4334-a92c-d86980400555 req-90e74a4f-46f6-418f-b66a-ee2a99f283a8 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 619.956156] env[69274]: INFO networking_nsxv3.common.synchronization [req-3420370c-866a-4334-a92c-d86980400555 req-90e74a4f-46f6-418f-b66a-ee2a99f283a8 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 619.956211] env[69274]: INFO networking_nsxv3.common.synchronization [req-3420370c-866a-4334-a92c-d86980400555 req-90e74a4f-46f6-418f-b66a-ee2a99f283a8 service nova] Enqueued Resource ID: d04e31bf-cc32-4453-8b4a-5169d1a4d635 with Priority: HIGHEST for action port [ 619.956451] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 619.956827] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 619.956944] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d04e31bf-cc32-4453-8b4a-5169d1a4d635 with Priority: HIGHEST for action port [ 619.957726] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.957843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.957998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.958383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.958383] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.960197] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.960770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.960770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.960770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.960770] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.960949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.961141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.961193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.961318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.961370] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.962579] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d04e31bf-cc32-4453-8b4a-5169d1a4d635 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.962722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.962833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.962885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.962974] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04e31bf-cc32-4453-8b4a-5169d1a4d635',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.137019] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-285 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.137019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-285" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.137019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-285" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.137019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-285" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.137019] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.137019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.137019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.137019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.137019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.137019] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.137496] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.137496] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.137496] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.137496] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.137496] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.137660] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.158128] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.158996] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 620.159212] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.159473] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-285" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.159946] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-5e60ac4b-777d-4501-9004-9620fdcf0ca3 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.160174] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.160276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.160582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.160742] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e60ac4b-777d-4501-9004-9620fdcf0ca3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.224657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.224852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.224955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.225254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.225449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.225636] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.225924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.225924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.226216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.226216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.226423] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 already deleted. [ 620.226471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.429391] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 620.429918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.461478] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.461478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.463529] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.464805] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d04e31bf-cc32-4453-8b4a-5169d1a4d635 with status ACTIVE [ 620.465160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.465578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.467042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.467042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.467042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.467042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.467042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.467042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.467042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.467042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.467745] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.468035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.468162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.468359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.468599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.468599] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d04e31bf-cc32-4453-8b4a-5169d1a4d635 is going to be updated. [ 620.496734] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.496734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.496734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.496734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.496734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.496734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d04e31bf-cc32-4453-8b4a-5169d1a4d635" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.663876] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.664282] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.664608] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.664944] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.665167] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.665483] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 5e60ac4b-777d-4501-9004-9620fdcf0ca3 not found, creating... [ 620.665779] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.665923] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.667604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.667604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.667604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.667871] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.668141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.668310] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.668559] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.669491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.669491] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 5e60ac4b-777d-4501-9004-9620fdcf0ca3 is going to be created. [ 620.690505] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.691146] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.691344] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.691705] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.692428] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.692654] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.806323] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc14d56-7e2f-4186-9451-37adac5c5b23 in Status: SUCCESS [ 620.806591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.806743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.807021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.807192] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.807320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.807385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.807547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.807645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.807776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.807887] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.971049] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.311012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.311012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.311012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.311012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.311012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.311012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.311012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.311012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.311651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.311651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.311651] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.311651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.311651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.311901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.311901] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.312119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.312119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.312301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.312301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.312375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.315788] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.474160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.474536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.476191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.476519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.476685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.476847] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be created. [ 621.509404] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.509404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.509404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.509404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.509404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.521955] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: UNINITIALIZED for 2s [ 621.523550] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 in Status: SUCCESS [ 621.523550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.695898] env[69274]: INFO networking_nsxv3.common.synchronization [req-7810e047-b9f2-401d-ad01-38b0508b6bf6 req-03b3ba2a-9dfb-4e22-8caa-e954d4ef2d53 service nova] Enqueued Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_rules [ 621.696138] env[69274]: INFO networking_nsxv3.common.synchronization [req-7810e047-b9f2-401d-ad01-38b0508b6bf6 req-03b3ba2a-9dfb-4e22-8caa-e954d4ef2d53 service nova] Enqueued Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_members [ 621.696237] env[69274]: INFO networking_nsxv3.common.synchronization [req-7810e047-b9f2-401d-ad01-38b0508b6bf6 req-03b3ba2a-9dfb-4e22-8caa-e954d4ef2d53 service nova] Enqueued Resource ID: 5e60ac4b-777d-4501-9004-9620fdcf0ca3 with Priority: HIGHEST for action port [ 621.696469] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_rules [ 621.696600] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_members [ 621.696698] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e60ac4b-777d-4501-9004-9620fdcf0ca3 with Priority: HIGHEST for action port [ 621.698758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.699040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.699172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.699527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.699625] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.700607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.700742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.700831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.701052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.701222] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.701329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.701392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.701723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.701723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.701723] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.706641] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e60ac4b-777d-4501-9004-9620fdcf0ca3 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.706641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.706641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.706641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.706641] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e60ac4b-777d-4501-9004-9620fdcf0ca3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.820569] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efc14d56-7e2f-4186-9451-37adac5c5b23: rpc.has_security_group_logging(os_id): False [ 621.839272] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.839471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.839551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.839873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.839985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.840189] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.840792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.840792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.840792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.840792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.841051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.841163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.841230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.841382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.841481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.841724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.841906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.841942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.842967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.843080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.843187] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efc14d56-7e2f-4186-9451-37adac5c5b23 is going to be created. [ 621.910230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.911555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.912302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.912302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.912441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.925914] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efc14d56-7e2f-4186-9451-37adac5c5b23 in Status: IN_PROGRESS for 2s [ 622.207648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.207648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.209534] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.209534] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e60ac4b-777d-4501-9004-9620fdcf0ca3 with status ACTIVE [ 622.209534] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.210044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.210044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.210044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.210462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.210664] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.210773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.210909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.211079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.211423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.211423] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.211423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.211616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.211616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.211696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.211832] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e60ac4b-777d-4501-9004-9620fdcf0ca3 is going to be updated. [ 622.253053] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.253315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.253404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.253573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.253721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.253938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e60ac4b-777d-4501-9004-9620fdcf0ca3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.713966] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.216717] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.217073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.217073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.217311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.217415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.217526] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 is going to be created. [ 623.249294] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.249782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.249937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.250191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.250410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.266502] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 in Status: UNINITIALIZED for 2s [ 623.546359] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 623.546772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.546982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.547257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.547475] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.547615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.547666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.547861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.547962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.548067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.548163] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.947304] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efc14d56-7e2f-4186-9451-37adac5c5b23 in Status: SUCCESS [ 623.947647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.053741] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.053741] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.053741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.053741] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.054732] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.055189] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.394762] env[69274]: INFO networking_nsxv3.common.synchronization [None req-1e731fff-ff3b-4c1b-9e7b-87984c3c99e5 None None] Enqueued Resource ID: b00d5e16-bf20-4c13-8f04-c55ad9eb17e2 with Priority: HIGHEST for action port [ 624.398329] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00d5e16-bf20-4c13-8f04-c55ad9eb17e2 with Priority: HIGHEST for action port [ 624.398329] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b00d5e16-bf20-4c13-8f04-c55ad9eb17e2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.398329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b00d5e16-bf20-4c13-8f04-c55ad9eb17e2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.398329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b00d5e16-bf20-4c13-8f04-c55ad9eb17e2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.398329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b00d5e16-bf20-4c13-8f04-c55ad9eb17e2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.398329] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00d5e16-bf20-4c13-8f04-c55ad9eb17e2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.560667] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c216e0c6-b262-4569-8d09-772eeaa39501: rpc.has_security_group_logging(os_id): False [ 624.592836] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.593037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.593080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.594330] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.594330] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.594330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.594669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.594669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.594943] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.595079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.597279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.597279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.597279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.597279] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be created. [ 624.685246] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.685246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.685246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.685246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.685246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.699852] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 624.902507] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b00d5e16-bf20-4c13-8f04-c55ad9eb17e2 [ 624.902507] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.902703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.902776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.903158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.903264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.903368] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b00d5e16-bf20-4c13-8f04-c55ad9eb17e2 already deleted. [ 624.903453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b00d5e16-bf20-4c13-8f04-c55ad9eb17e2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.071132] env[69274]: INFO networking_nsxv3.common.synchronization [req-600a6e9a-346d-4a84-b50a-3717f2a21750 req-07fbb392-80d4-4241-bea6-e58535bbc52b tempest-ServersWithSpecificFlavorTestJSON-7327972 tempest-ServersWithSpecificFlavorTestJSON-7327972-project-member] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 625.075871] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 625.075871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.075871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.075871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.075871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.075871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.075871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.075871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.075871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.075871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.075871] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.286246] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 in Status: SUCCESS [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.286246] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.286246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.286246] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.562022] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.562022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.562022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.562594] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.563085] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.563085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.563350] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.565570] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.565900] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.565900] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.566092] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.567876] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.567876] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.567876] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.567876] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.567876] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.578760] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.578967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.579096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.579321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.579449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.579680] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.581041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.581041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.581041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.581041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.581041] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a already deleted. [ 625.581041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.586271] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.586375] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 625.586529] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.586720] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.587039] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-366c5862-ae6b-457d-94c7-1d04577581f9 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.587220] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.587343] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.587653] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.587791] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366c5862-ae6b-457d-94c7-1d04577581f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.789161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.789161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.789161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.789161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.789161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.789161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.789161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.789537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.789537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.789537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.789633] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.789708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.789831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.789987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.790205] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.790325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.790404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.790563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.790683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.790795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.790876] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.093136] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.093136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.093136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.093136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.093136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.093136] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 366c5862-ae6b-457d-94c7-1d04577581f9 not found, creating... [ 626.093136] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.093136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.093136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.093136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.097855] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.097855] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.097855] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.097855] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.097855] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.097855] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.097855] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 366c5862-ae6b-457d-94c7-1d04577581f9 is going to be created. [ 626.127205] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.127205] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.127205] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.127205] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.127205] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.127205] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.295433] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5932b9-8178-492f-bc28-0e93951e6eb4: rpc.has_security_group_logging(os_id): False [ 626.326706] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.328103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.328283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.328666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.329154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.329461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.330292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.330445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.330683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.330850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.331164] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.331285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.331357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.331587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.331685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.331905] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.332024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.332100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.332293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.332453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.332491] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 is going to be created. [ 626.422207] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.422544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.422681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.422915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.423253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.450340] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 in Status: IN_PROGRESS for 2s [ 626.512230] env[69274]: INFO networking_nsxv3.common.synchronization [None req-91e34544-0d14-497e-ab7c-a745e153d078 None None] Enqueued Resource ID: 67c3905f-21b1-499b-9aba-1af787595e53 with Priority: HIGHEST for action port [ 626.515034] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c3905f-21b1-499b-9aba-1af787595e53 with Priority: HIGHEST for action port [ 626.515034] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-67c3905f-21b1-499b-9aba-1af787595e53 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.515034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67c3905f-21b1-499b-9aba-1af787595e53" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.515034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67c3905f-21b1-499b-9aba-1af787595e53" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.515034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67c3905f-21b1-499b-9aba-1af787595e53" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.515034] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67c3905f-21b1-499b-9aba-1af787595e53',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.672936] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7ed63688-7926-4e0b-94a5-c1a337212ace None None] Enqueued Resource ID: 18794ca8-c167-4d05-b1f9-3078e1981054 with Priority: HIGHEST for action port [ 626.674046] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18794ca8-c167-4d05-b1f9-3078e1981054 with Priority: HIGHEST for action port [ 626.674569] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-18794ca8-c167-4d05-b1f9-3078e1981054 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.674767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18794ca8-c167-4d05-b1f9-3078e1981054" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.674883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18794ca8-c167-4d05-b1f9-3078e1981054" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.675295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18794ca8-c167-4d05-b1f9-3078e1981054" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.675410] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18794ca8-c167-4d05-b1f9-3078e1981054',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.716989] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 626.717340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.018981] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67c3905f-21b1-499b-9aba-1af787595e53 [ 627.019151] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.019269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.019384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.019713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.019860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.019971] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67c3905f-21b1-499b-9aba-1af787595e53 already deleted. [ 627.020246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67c3905f-21b1-499b-9aba-1af787595e53" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.182718] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18794ca8-c167-4d05-b1f9-3078e1981054 [ 627.182893] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.182977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.183026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.183382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.183382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.183599] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18794ca8-c167-4d05-b1f9-3078e1981054 already deleted. [ 627.183599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18794ca8-c167-4d05-b1f9-3078e1981054" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.725348] env[69274]: INFO networking_nsxv3.common.synchronization [req-600a6e9a-346d-4a84-b50a-3717f2a21750 req-07e2d90d-8ac7-49e7-9d59-ff521e2cb3aa service nova] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 627.725674] env[69274]: INFO networking_nsxv3.common.synchronization [req-600a6e9a-346d-4a84-b50a-3717f2a21750 req-07e2d90d-8ac7-49e7-9d59-ff521e2cb3aa service nova] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 627.725674] env[69274]: INFO networking_nsxv3.common.synchronization [req-600a6e9a-346d-4a84-b50a-3717f2a21750 req-07e2d90d-8ac7-49e7-9d59-ff521e2cb3aa service nova] Enqueued Resource ID: 366c5862-ae6b-457d-94c7-1d04577581f9 with Priority: HIGHEST for action port [ 627.727577] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 627.727577] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 627.727577] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 366c5862-ae6b-457d-94c7-1d04577581f9 with Priority: HIGHEST for action port [ 627.727822] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.727925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.727995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.728363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.728593] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.729696] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.730949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.730949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.730949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.730949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.730949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.730949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.730949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.731294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.731294] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.732036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-366c5862-ae6b-457d-94c7-1d04577581f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.732177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.732177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.733297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.733297] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('366c5862-ae6b-457d-94c7-1d04577581f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.236096] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.239263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.239263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.241031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 366c5862-ae6b-457d-94c7-1d04577581f9 with status ACTIVE [ 628.242276] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.242887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.243979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.246041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.246041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.246041] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.246041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.246041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.246041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.246531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.246955] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.249277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.249277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.249277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.249277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.249277] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 366c5862-ae6b-457d-94c7-1d04577581f9 is going to be updated. [ 628.282497] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.282497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.282497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.282497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.282497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.282497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-366c5862-ae6b-457d-94c7-1d04577581f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.464675] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 in Status: SUCCESS [ 628.464842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.753035] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.015390] env[69274]: INFO networking_nsxv3.common.synchronization [req-8134107f-2c2d-4651-94bb-1beb87283d7d req-784b5d0b-49e3-449c-a069-f10f6c200e9a tempest-InstanceActionsTestJSON-180677158 tempest-InstanceActionsTestJSON-180677158-project-member] Enqueued Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_members [ 629.016083] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGHEST for action security_group_members [ 629.017021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.017021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.017021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.017021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.017021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.022204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.022204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.022204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.022204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.022204] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.257703] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.257703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.257703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.257703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.257703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.257703] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be created. [ 629.288297] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.288453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.288453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.288676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.288810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.303349] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: UNINITIALIZED for 2s [ 629.526138] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.526138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.526138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.526318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.528321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.528321] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.528321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.528321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.528321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.528321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.528321] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8017f169-c9ea-4513-9df7-442186576b39 is going to be updated. [ 629.560966] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.561195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.561278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.561487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.561632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.573598] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8017f169-c9ea-4513-9df7-442186576b39 in Status: IN_PROGRESS for 2s [ 629.989779] env[69274]: INFO networking_nsxv3.common.synchronization [None req-bdbef1c8-91a3-4937-98ca-4a4202db3bf8 None None] Enqueued Resource ID: 2f17ef4b-a5e3-4307-a416-37ca376c2105 with Priority: HIGHEST for action port [ 629.992838] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f17ef4b-a5e3-4307-a416-37ca376c2105 with Priority: HIGHEST for action port [ 629.992838] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f17ef4b-a5e3-4307-a416-37ca376c2105 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.992838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f17ef4b-a5e3-4307-a416-37ca376c2105" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.992838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f17ef4b-a5e3-4307-a416-37ca376c2105" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.992838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f17ef4b-a5e3-4307-a416-37ca376c2105" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.992838] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f17ef4b-a5e3-4307-a416-37ca376c2105',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.367077] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a1fb5c5-6269-462f-90fa-6fe3b750b261 req-05831428-526e-4838-9abe-6fde4223a7bc tempest-ServersTestFqdnHostnames-1855747695 tempest-ServersTestFqdnHostnames-1855747695-project-member] Enqueued Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_members [ 630.367077] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_members [ 630.367386] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.368448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.368448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.368448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.368448] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.368448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.368448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.368448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.368448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.368817] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.495928] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f17ef4b-a5e3-4307-a416-37ca376c2105 [ 630.496188] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.496344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.496418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.496607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.496693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.497325] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f17ef4b-a5e3-4307-a416-37ca376c2105 already deleted. [ 630.497325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f17ef4b-a5e3-4307-a416-37ca376c2105" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.873027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.873027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.873027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.873230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.873377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.873636] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.873752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.874076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.874076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.874076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.874206] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b already deleted. [ 630.874237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.028738] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.028738] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-91" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.028738] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-91" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.029090] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-91" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.029225] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.031202] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.031381] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.031679] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.031873] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.032184] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 631.032367] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.032483] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.032640] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.032801] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 631.036297] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.036297] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.057877] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.057877] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 631.057997] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.058214] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-91" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.058601] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.058744] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.058873] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.059182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.059322] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff482c9-a8fe-4db4-bf88-f73611e07c2d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.312976] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 631.313291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.313465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.313709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.314483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.314740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.314858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.315077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.315194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.315318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.315398] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.564440] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.564659] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.564784] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.565088] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.565274] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.565436] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 1ff482c9-a8fe-4db4-bf88-f73611e07c2d not found, creating... [ 631.565701] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.565870] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.565985] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.566259] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.566421] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.566858] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.566948] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.568419] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.568419] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.568419] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.568979] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 1ff482c9-a8fe-4db4-bf88-f73611e07c2d is going to be created. [ 631.587864] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8017f169-c9ea-4513-9df7-442186576b39 in Status: SUCCESS [ 631.588043] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8017f169-c9ea-4513-9df7-442186576b39 deletion is rescheduled due to dependency. [ 631.588242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.600751] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.601029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.601174] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.601562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.601827] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.602128] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.822188] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.323238] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a: rpc.has_security_group_logging(os_id): False [ 632.346360] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.346596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.346660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.348517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.348517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.348517] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.348517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.348517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.348517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.348755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.348755] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be created. [ 632.417349] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.417529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.417529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.417685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.419754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.434737] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: IN_PROGRESS for 2s [ 632.531751] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a1fb5c5-6269-462f-90fa-6fe3b750b261 req-0ac470f9-11ea-4566-b036-921f31cd1478 service nova] Enqueued Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_rules [ 632.534409] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a1fb5c5-6269-462f-90fa-6fe3b750b261 req-0ac470f9-11ea-4566-b036-921f31cd1478 service nova] Enqueued Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_members [ 632.534409] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a1fb5c5-6269-462f-90fa-6fe3b750b261 req-0ac470f9-11ea-4566-b036-921f31cd1478 service nova] Enqueued Resource ID: 1ff482c9-a8fe-4db4-bf88-f73611e07c2d with Priority: HIGHEST for action port [ 632.534409] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_rules [ 632.534409] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_members [ 632.534409] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff482c9-a8fe-4db4-bf88-f73611e07c2d with Priority: HIGHEST for action port [ 632.534409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.534409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.534409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.534409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.534409] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.537463] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.537463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.537463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.537463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.537463] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.537463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.537463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.540246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.540246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.540246] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.540990] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.541115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.541600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.541600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.541600] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff482c9-a8fe-4db4-bf88-f73611e07c2d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.046517] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.046664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.046894] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.048240] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ff482c9-a8fe-4db4-bf88-f73611e07c2d with status ACTIVE [ 633.048432] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.048556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.048630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.048837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.048933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.049179] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.049302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.049302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.049456] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.049535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.049714] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.049824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.049989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.050661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.050765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.050856] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ff482c9-a8fe-4db4-bf88-f73611e07c2d is going to be updated. [ 633.081267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.081419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.081487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.081700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.081835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.082011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff482c9-a8fe-4db4-bf88-f73611e07c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.153898] env[69274]: INFO networking_nsxv3.common.synchronization [req-1dd5fc09-e34d-4ad5-9f7a-2794857652ae req-2468a7ed-cdc0-4c14-b0cb-40be110d7938 tempest-ServerDiagnosticsNegativeTest-323261654 tempest-ServerDiagnosticsNegativeTest-323261654-project-member] Enqueued Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_members [ 633.154617] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGHEST for action security_group_members [ 633.154781] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.154905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.155074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.157646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.157749] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.158337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.158337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.158337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.160187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.160417] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.552964] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.663409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.663409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.663409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.663636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.663703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.663991] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.663991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.664125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.664202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.664260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.664344] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc14d56-7e2f-4186-9451-37adac5c5b23 is going to be updated. [ 633.693816] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.693928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.693965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.694255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.694414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.707241] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc14d56-7e2f-4186-9451-37adac5c5b23 in Status: IN_PROGRESS for 2s [ 634.055607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.055969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.055969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.061397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.061397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.061397] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b is going to be created. [ 634.100108] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.100108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.100108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.100108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.100108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.115867] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b in Status: UNINITIALIZED for 2s [ 634.447890] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 634.448168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.721798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efc14d56-7e2f-4186-9451-37adac5c5b23 in Status: SUCCESS [ 635.721798] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efc14d56-7e2f-4186-9451-37adac5c5b23 deletion is rescheduled due to dependency. [ 635.721798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.920491] env[69274]: INFO networking_nsxv3.common.synchronization [req-8887e19f-0c71-4a39-8e4b-fbf13bc55131 req-e4de26e7-e398-4d36-b405-863a11044401 tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 635.921198] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 635.922630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.922630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.922630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.922630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.922630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.922630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.922630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.922630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.922630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.923790] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.127301] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b in Status: SUCCESS [ 636.127554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.128336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.128336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.128336] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.128336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.128336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.128548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.128581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.128663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.128755] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.428422] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.428590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.428659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.431901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.431901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.431901] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.431901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.431901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.431901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.431901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.431901] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be updated. [ 636.460750] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.460927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.461015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.461251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.461396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.472086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 636.631461] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.994869] env[69274]: INFO networking_nsxv3.common.synchronization [req-ee52f382-a8d8-45f3-95d8-73a08f16524f req-b1e14b18-37cf-4fba-a63c-11aedbc234eb tempest-ServerPasswordTestJSON-1705473031 tempest-ServerPasswordTestJSON-1705473031-project-member] Enqueued Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_members [ 636.995160] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGHEST for action security_group_members [ 636.995523] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.995763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.995763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.998192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.998301] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.998428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.998502] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.998666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.998753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.998867] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.134597] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76ed45ab-938f-474a-bc5b-d957fa7e4a5b: rpc.has_security_group_logging(os_id): False [ 637.155570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.155570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.155570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.155968] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b is going to be created. [ 637.249053] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.249248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.249295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.249500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.249688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.265673] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b in Status: IN_PROGRESS for 2s [ 637.502999] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.503308] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.503385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.503613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.503713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.503924] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.504041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.504107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.504260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.504367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.504465] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 is going to be updated. [ 637.545110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.545110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.545110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.549815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.549815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.555818] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 in Status: IN_PROGRESS for 2s [ 637.683066] env[69274]: INFO networking_nsxv3.common.synchronization [None req-39641930-3dc6-408c-b2fb-b727d70e944e None None] Enqueued Resource ID: 3d07e773-de72-4876-9bd5-448436d6c1e6 with Priority: HIGHEST for action port [ 637.683954] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d07e773-de72-4876-9bd5-448436d6c1e6 with Priority: HIGHEST for action port [ 637.684527] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d07e773-de72-4876-9bd5-448436d6c1e6 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.684628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d07e773-de72-4876-9bd5-448436d6c1e6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.684718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d07e773-de72-4876-9bd5-448436d6c1e6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.685478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d07e773-de72-4876-9bd5-448436d6c1e6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.685478] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d07e773-de72-4876-9bd5-448436d6c1e6',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.187283] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d07e773-de72-4876-9bd5-448436d6c1e6 [ 638.187580] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.187651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.187730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.188016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.188124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.188325] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d07e773-de72-4876-9bd5-448436d6c1e6 already deleted. [ 638.188325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d07e773-de72-4876-9bd5-448436d6c1e6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.484124] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 638.484255] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 deletion is rescheduled due to dependency. [ 638.484890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.523243] env[69274]: INFO networking_nsxv3.common.synchronization [req-4cfa3c17-a125-417a-9c47-03166d426735 req-11497b47-9cfb-42f0-abf3-aadd3b4e2547 tempest-ServersAdminNegativeTestJSON-1537378782 tempest-ServersAdminNegativeTestJSON-1537378782-project-member] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 638.524357] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 638.524357] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.524617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.524617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.524779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.524937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.525046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.525108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.525263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.525348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.525445] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.651619] env[69274]: INFO networking_nsxv3.common.synchronization [None req-502cb122-2d7e-47be-b3cc-f1f19ae1a6a9 None None] Enqueued Resource ID: 2cbbbeb6-4975-4852-9e4f-33f46184e136 with Priority: HIGHEST for action port [ 638.651619] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cbbbeb6-4975-4852-9e4f-33f46184e136 with Priority: HIGHEST for action port [ 638.651946] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cbbbeb6-4975-4852-9e4f-33f46184e136 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.653028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cbbbeb6-4975-4852-9e4f-33f46184e136" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.653028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cbbbeb6-4975-4852-9e4f-33f46184e136" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.653028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cbbbeb6-4975-4852-9e4f-33f46184e136" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.653190] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cbbbeb6-4975-4852-9e4f-33f46184e136',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.796660] env[69274]: INFO networking_nsxv3.common.synchronization [None req-ca930311-88cc-4017-8294-15b885ccb90b None None] Enqueued Resource ID: 4be8f2b2-f832-4dc7-af99-22d30267192c with Priority: HIGHEST for action port [ 638.796660] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be8f2b2-f832-4dc7-af99-22d30267192c with Priority: HIGHEST for action port [ 638.796660] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-4be8f2b2-f832-4dc7-af99-22d30267192c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.798177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4be8f2b2-f832-4dc7-af99-22d30267192c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.798313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4be8f2b2-f832-4dc7-af99-22d30267192c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.798611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4be8f2b2-f832-4dc7-af99-22d30267192c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.798754] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4be8f2b2-f832-4dc7-af99-22d30267192c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.029355] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.029558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.029637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.031276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.031412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.031662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.031805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.031873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.032059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.032149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.032258] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 already deleted. [ 639.032375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.158496] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cbbbeb6-4975-4852-9e4f-33f46184e136 [ 639.158760] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.158908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.158981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.159240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.159344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.159489] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cbbbeb6-4975-4852-9e4f-33f46184e136 already deleted. [ 639.159664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cbbbeb6-4975-4852-9e4f-33f46184e136" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.282222] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b in Status: SUCCESS [ 639.284592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.302380] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4be8f2b2-f832-4dc7-af99-22d30267192c [ 639.302380] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.302380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.303799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.303799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.303799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.303799] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4be8f2b2-f832-4dc7-af99-22d30267192c already deleted. [ 639.303799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4be8f2b2-f832-4dc7-af99-22d30267192c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.567723] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 in Status: SUCCESS [ 639.567723] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 deletion is rescheduled due to dependency. [ 639.567723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.605454] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.605454] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.605454] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.605454] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.605454] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.606513] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.606669] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.606902] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.607726] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.607726] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.607726] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.607726] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.607726] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.607726] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.608126] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.608126] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.629807] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.629888] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.630121] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.630491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.630641] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-08063e6d-9b79-4dd6-a96b-d37b8cae405f taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.630803] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.630960] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.631403] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.631510] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08063e6d-9b79-4dd6-a96b-d37b8cae405f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.134412] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.134639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.134783] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.135109] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.135281] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.135460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 08063e6d-9b79-4dd6-a96b-d37b8cae405f not found, creating... [ 640.135756] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.135948] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.136094] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.136333] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.136472] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.136781] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.136939] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.139022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.139022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.139022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.139022] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 08063e6d-9b79-4dd6-a96b-d37b8cae405f is going to be created. [ 640.163288] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.163833] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.164192] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.164533] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.164837] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.165246] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.707057] env[69274]: INFO networking_nsxv3.common.synchronization [req-a660ab82-1b17-426b-aa6f-2bae2cf54a62 req-7a917156-7e86-4a53-8be5-459acd6aa349 tempest-ImagesOneServerTestJSON-624855269 tempest-ImagesOneServerTestJSON-624855269-project-member] Enqueued Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_members [ 640.707723] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_members [ 640.708050] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.708207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.708280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.708538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.708704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.708806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.708868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.709051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.709140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.709239] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.759630] env[69274]: INFO networking_nsxv3.common.synchronization [None req-c855c5d7-9170-4106-9dd0-7b39c0e7f905 None None] Enqueued Resource ID: 8e2bf631-0654-4a3a-8d37-12dcd3c61aaa with Priority: HIGHEST for action port [ 640.760253] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e2bf631-0654-4a3a-8d37-12dcd3c61aaa with Priority: HIGHEST for action port [ 640.760609] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e2bf631-0654-4a3a-8d37-12dcd3c61aaa taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.761232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e2bf631-0654-4a3a-8d37-12dcd3c61aaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.761370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e2bf631-0654-4a3a-8d37-12dcd3c61aaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.762914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e2bf631-0654-4a3a-8d37-12dcd3c61aaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.763020] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e2bf631-0654-4a3a-8d37-12dcd3c61aaa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.819978] env[69274]: INFO networking_nsxv3.common.synchronization [None req-ee4a2505-a6c9-446f-bf4b-ff447089dbe9 None None] Enqueued Resource ID: 5fd32afd-575b-45b3-a15c-e8db2b1b655b with Priority: HIGHEST for action port [ 640.821118] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd32afd-575b-45b3-a15c-e8db2b1b655b with Priority: HIGHEST for action port [ 640.821645] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fd32afd-575b-45b3-a15c-e8db2b1b655b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.823052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fd32afd-575b-45b3-a15c-e8db2b1b655b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.823052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fd32afd-575b-45b3-a15c-e8db2b1b655b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.823052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fd32afd-575b-45b3-a15c-e8db2b1b655b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.823052] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fd32afd-575b-45b3-a15c-e8db2b1b655b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.212143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.212357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.212437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.212712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.212848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.213167] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.213303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.213452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.213540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.213622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.213710] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb already deleted. [ 641.213792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.266104] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e2bf631-0654-4a3a-8d37-12dcd3c61aaa [ 641.267706] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.267706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.267706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.267706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.267706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.267706] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e2bf631-0654-4a3a-8d37-12dcd3c61aaa already deleted. [ 641.267706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e2bf631-0654-4a3a-8d37-12dcd3c61aaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.333331] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fd32afd-575b-45b3-a15c-e8db2b1b655b [ 641.333331] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.333331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.333331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.333331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.333331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.333331] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fd32afd-575b-45b3-a15c-e8db2b1b655b already deleted. [ 641.333331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fd32afd-575b-45b3-a15c-e8db2b1b655b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.464676] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.464894] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.465031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.465334] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.465619] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.465777] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.465894] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.467080] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.467302] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.470567] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.470567] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.470567] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.470711] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.470866] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.470936] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.471066] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.491375] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.491528] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 641.491661] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.491842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.495198] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-87895686-1b34-45b9-9736-a69d02dd16c7 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.495475] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.495641] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.496039] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.496190] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87895686-1b34-45b9-9736-a69d02dd16c7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.652594] env[69274]: INFO networking_nsxv3.common.synchronization [req-4cfa3c17-a125-417a-9c47-03166d426735 req-8202c6bd-1a83-4613-8cbf-4e46d73a34c2 service nova] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_rules [ 641.652594] env[69274]: INFO networking_nsxv3.common.synchronization [req-4cfa3c17-a125-417a-9c47-03166d426735 req-8202c6bd-1a83-4613-8cbf-4e46d73a34c2 service nova] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 641.652594] env[69274]: INFO networking_nsxv3.common.synchronization [req-4cfa3c17-a125-417a-9c47-03166d426735 req-8202c6bd-1a83-4613-8cbf-4e46d73a34c2 service nova] Enqueued Resource ID: 08063e6d-9b79-4dd6-a96b-d37b8cae405f with Priority: HIGHEST for action port [ 641.652594] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_rules [ 641.652594] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 641.652594] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08063e6d-9b79-4dd6-a96b-d37b8cae405f with Priority: HIGHEST for action port [ 641.652594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.652594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.652594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.652594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.652594] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.658275] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.658275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.658275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.658275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.658275] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.658275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.658275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.658828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.658828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.658828] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.661515] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-08063e6d-9b79-4dd6-a96b-d37b8cae405f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.661515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.661515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.661515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.661515] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08063e6d-9b79-4dd6-a96b-d37b8cae405f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.001846] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.002200] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.002763] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.002763] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.005270] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.005312] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 87895686-1b34-45b9-9736-a69d02dd16c7 not found, creating... [ 642.005816] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.005917] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.005967] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.006535] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.006644] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.007045] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.007182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.007303] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.007540] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.007682] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.007829] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 87895686-1b34-45b9-9736-a69d02dd16c7 is going to be created. [ 642.036065] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.038487] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.038487] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.038651] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.038891] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.039261] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.051671] env[69274]: INFO networking_nsxv3.common.synchronization [None req-62459ba9-fc94-4172-bf3e-a6f989f375e2 None None] Enqueued Resource ID: 7d149020-656b-45d2-9a6a-30595438b475 with Priority: HIGHEST for action port [ 642.056039] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d149020-656b-45d2-9a6a-30595438b475 with Priority: HIGHEST for action port [ 642.056125] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d149020-656b-45d2-9a6a-30595438b475 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.056234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d149020-656b-45d2-9a6a-30595438b475" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.056301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d149020-656b-45d2-9a6a-30595438b475" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.056559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d149020-656b-45d2-9a6a-30595438b475" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.056642] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d149020-656b-45d2-9a6a-30595438b475',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.168361] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.170259] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.170259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.170259] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08063e6d-9b79-4dd6-a96b-d37b8cae405f with status ACTIVE [ 642.170259] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.170690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.170690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.170690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.170690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.170909] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.170909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.171065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.173433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.173731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.174107] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.174396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.174627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.174903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.175146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.175341] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08063e6d-9b79-4dd6-a96b-d37b8cae405f is going to be updated. [ 642.204431] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.204431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.204431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.204691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.204734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.204993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08063e6d-9b79-4dd6-a96b-d37b8cae405f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.560145] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d149020-656b-45d2-9a6a-30595438b475 [ 642.560145] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.560145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.560145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.560145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.560145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.560145] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d149020-656b-45d2-9a6a-30595438b475 already deleted. [ 642.560145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d149020-656b-45d2-9a6a-30595438b475" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.678221] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.836165] env[69274]: INFO networking_nsxv3.common.synchronization [None req-4175b66f-bd5a-47b6-bede-f54d29c81a97 None None] Enqueued Resource ID: 51cba238-76d4-41ea-b53a-029d6f64591b with Priority: HIGHEST for action port [ 642.836240] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51cba238-76d4-41ea-b53a-029d6f64591b with Priority: HIGHEST for action port [ 642.836623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-51cba238-76d4-41ea-b53a-029d6f64591b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.836881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51cba238-76d4-41ea-b53a-029d6f64591b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.836944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51cba238-76d4-41ea-b53a-029d6f64591b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.838626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51cba238-76d4-41ea-b53a-029d6f64591b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.838772] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51cba238-76d4-41ea-b53a-029d6f64591b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.914023] env[69274]: INFO networking_nsxv3.common.synchronization [req-a660ab82-1b17-426b-aa6f-2bae2cf54a62 req-69482afd-28e0-41bf-b430-6f9cd8e8381d service nova] Enqueued Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_rules [ 642.914023] env[69274]: INFO networking_nsxv3.common.synchronization [req-a660ab82-1b17-426b-aa6f-2bae2cf54a62 req-69482afd-28e0-41bf-b430-6f9cd8e8381d service nova] Enqueued Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_members [ 642.914023] env[69274]: INFO networking_nsxv3.common.synchronization [req-a660ab82-1b17-426b-aa6f-2bae2cf54a62 req-69482afd-28e0-41bf-b430-6f9cd8e8381d service nova] Enqueued Resource ID: 87895686-1b34-45b9-9736-a69d02dd16c7 with Priority: HIGHEST for action port [ 642.914023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_rules [ 642.914023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_members [ 642.914023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87895686-1b34-45b9-9736-a69d02dd16c7 with Priority: HIGHEST for action port [ 642.915334] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.915750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.915995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.917995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.917995] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.917995] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.917995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.917995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.917995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.917995] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.918363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.918363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.918363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.918478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.918514] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.923230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-87895686-1b34-45b9-9736-a69d02dd16c7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.923453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.923453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.924167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.924167] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87895686-1b34-45b9-9736-a69d02dd16c7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.182077] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.182878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.183792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.184477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.184933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.184933] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be created. [ 643.216271] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.216823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.217650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.217995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.218185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.237891] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: UNINITIALIZED for 2s [ 643.345359] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51cba238-76d4-41ea-b53a-029d6f64591b [ 643.345359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.345359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.345359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.345359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.345359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.345359] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51cba238-76d4-41ea-b53a-029d6f64591b already deleted. [ 643.345359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51cba238-76d4-41ea-b53a-029d6f64591b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.425540] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.425902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.430445] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.433307] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87895686-1b34-45b9-9736-a69d02dd16c7 with status ACTIVE [ 643.433307] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.433307] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.433307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.434170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.434313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.434488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.434670] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.434905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.434938] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87895686-1b34-45b9-9736-a69d02dd16c7 is going to be updated. [ 643.459607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.459840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.459840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.460191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.460355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.460529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87895686-1b34-45b9-9736-a69d02dd16c7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.613912] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca1807fe-da3a-4d5e-ba0d-648d7006b278 req-6c19ac3f-e3b4-4788-8723-eb4a22a34505 tempest-MigrationsAdminTest-608694291 tempest-MigrationsAdminTest-608694291-project-member] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 643.613912] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 643.613912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.614470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.614470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.614470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.614565] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.614616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.614704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.614838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.614922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.615099] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.937145] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.988313] env[69274]: INFO networking_nsxv3.common.synchronization [None req-fc003708-30f1-47cd-a759-ce910ee5c701 None None] Enqueued Resource ID: 1d4adc06-41d8-4546-837e-e08ded68cd4a with Priority: HIGHEST for action port [ 643.989023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d4adc06-41d8-4546-837e-e08ded68cd4a with Priority: HIGHEST for action port [ 643.989395] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d4adc06-41d8-4546-837e-e08ded68cd4a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.989395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d4adc06-41d8-4546-837e-e08ded68cd4a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.989395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d4adc06-41d8-4546-837e-e08ded68cd4a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.989651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d4adc06-41d8-4546-837e-e08ded68cd4a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.989739] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d4adc06-41d8-4546-837e-e08ded68cd4a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.118340] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.118497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.118567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.118793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.118881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.119090] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.119572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.119572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.119572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.119572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.119848] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 already deleted. [ 644.119848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.270628] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.271584] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.271790] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.272721] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.273116] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.273308] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.273504] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.273702] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.273862] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.274112] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.274280] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.274418] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.274542] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.274674] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.274807] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.274947] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.301367] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.303201] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 644.304120] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.305393] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.305865] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.306629] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.306629] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.308056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.308056] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba54240-0c28-4ede-9d1d-a0eecebf1c2d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.370136] env[69274]: INFO networking_nsxv3.common.synchronization [None req-01cf3a1b-c519-4af4-b250-b524255c114a tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 644.370136] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 644.371638] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.371919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.372474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.372822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.373602] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.443064] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.443409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.443409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.443538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.443595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.444047] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb is going to be created. [ 644.475417] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.475417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.475417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.475417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.475417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.486360] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb in Status: UNINITIALIZED for 2s [ 644.491769] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d4adc06-41d8-4546-837e-e08ded68cd4a [ 644.492038] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.492230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.492344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.492589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.492687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.492790] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d4adc06-41d8-4546-837e-e08ded68cd4a already deleted. [ 644.492878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d4adc06-41d8-4546-837e-e08ded68cd4a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.632617] env[69274]: INFO networking_nsxv3.common.synchronization [None req-067c8295-f140-4d71-80f7-47b7225a1a8b tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 644.633163] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 644.634901] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.634901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.811503] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.811656] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.811702] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.811966] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.813117] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.813117] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port aba54240-0c28-4ede-9d1d-a0eecebf1c2d not found, creating... [ 644.813117] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.813117] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.813117] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.813117] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.813410] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.813514] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.813666] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.813780] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.814010] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.815468] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.815468] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: aba54240-0c28-4ede-9d1d-a0eecebf1c2d is going to be created. [ 644.838111] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.838398] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.838525] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.838793] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.839047] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.839265] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.898303] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.898518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.898566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.898774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.898902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.899021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 already deleted. [ 644.899151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.899328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.899531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.899621] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.257262] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: SUCCESS [ 645.258106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.258388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.258696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.258951] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.259065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.259114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.259277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.260366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.260878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.261152] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.430133] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.430133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.430612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.430612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.430612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.430718] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 already deleted. [ 645.430799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.619519] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca1807fe-da3a-4d5e-ba0d-648d7006b278 req-389132f6-9ef1-4f62-865c-7b636f061574 service nova] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_rules [ 645.619724] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca1807fe-da3a-4d5e-ba0d-648d7006b278 req-389132f6-9ef1-4f62-865c-7b636f061574 service nova] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 645.619867] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca1807fe-da3a-4d5e-ba0d-648d7006b278 req-389132f6-9ef1-4f62-865c-7b636f061574 service nova] Enqueued Resource ID: aba54240-0c28-4ede-9d1d-a0eecebf1c2d with Priority: HIGHEST for action port [ 645.620204] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_rules [ 645.620342] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 645.620440] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba54240-0c28-4ede-9d1d-a0eecebf1c2d with Priority: HIGHEST for action port [ 645.620981] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.621190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.621239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.621494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.621580] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.622440] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.622591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.622672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.622854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.623015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.623126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.623193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.623342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.623428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.623519] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.624756] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.624756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.624756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.624756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.624756] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba54240-0c28-4ede-9d1d-a0eecebf1c2d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.767549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.767549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.767549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.767549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.767549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.768328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.768328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.768328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.768328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.768328] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.921355] env[69274]: INFO networking_nsxv3.common.synchronization [req-3cada99c-1bfe-4e7f-93d1-1bbd1d5fa3b6 req-6f3a4bb2-4331-4afc-beed-e86abe2b636d tempest-VolumesAssistedSnapshotsTest-309329079 tempest-VolumesAssistedSnapshotsTest-309329079-project-member] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_members [ 645.925356] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_members [ 645.925970] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.926147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.926299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.926494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.926663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.926759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.926828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.927026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.927123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.927216] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.130120] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.130363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.130576] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.131777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aba54240-0c28-4ede-9d1d-a0eecebf1c2d with status ACTIVE [ 646.131777] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.131930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.131930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.132148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.132250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.132435] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.132536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.132598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.132770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.132892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.133187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.133285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.133391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.133473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.133552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.133658] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aba54240-0c28-4ede-9d1d-a0eecebf1c2d is going to be updated. [ 646.160917] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.160917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.160917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.161247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.161340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.161503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba54240-0c28-4ede-9d1d-a0eecebf1c2d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.272279] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59b1a355-727a-429c-8793-e86ce70f75b8: rpc.has_security_group_logging(os_id): False [ 646.301109] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.301109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.301320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.301354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.301448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.301749] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.301749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.301908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.301953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.302059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.302324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.303068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.303068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.303068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.303068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.303068] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.303068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.303300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.303783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.303783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.303783] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be created. [ 646.310439] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.310710] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-137" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.310877] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-137" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.311307] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-137" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.312091] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.313275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.313845] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.313845] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.313845] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.314112] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.314243] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.314358] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.314542] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.315037] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.315037] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.315037] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.341978] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.342058] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 646.342328] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.342810] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-137" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.343054] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d7182cce-17f9-40a8-8edb-ae992a459c6d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.343554] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.343554] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.345566] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.345566] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7182cce-17f9-40a8-8edb-ae992a459c6d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.399231] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.400409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.400409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.400590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.400815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.423420] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: IN_PROGRESS for 2s [ 646.433715] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.434013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.434055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.434891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.434891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.434891] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.434891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.434891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.435280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.435280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.435347] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 already deleted. [ 646.435420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.500936] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb in Status: SUCCESS [ 646.500936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.500936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.501217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.501486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.501486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.501684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.501840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.501950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.502078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.502187] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.636015] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.849029] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.849029] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port d7182cce-17f9-40a8-8edb-ae992a459c6d not found, creating... [ 646.849029] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.849029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.850347] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.851469] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.851469] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.853034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.853034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.853034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d7182cce-17f9-40a8-8edb-ae992a459c6d is going to be created. [ 646.882311] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.882311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.882311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.882311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.882311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.882311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.009326] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.009326] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.009326] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.009326] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.009326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.010316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.010316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.010316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.010316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.010316] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.140160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.140160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.140160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.140160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.140160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.140160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be created. [ 647.173985] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.174914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.176328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.176328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.176328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.188993] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: UNINITIALIZED for 2s [ 647.513056] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e13c3a51-4bc6-4f01-90fd-f18eece22adb: rpc.has_security_group_logging(os_id): False [ 647.533393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.533568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.533611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.533834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.533928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.534129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.534237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.534293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.534446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.534525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.534709] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.534808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.534870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.535016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.535098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.535320] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.535420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.535455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.535632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.535699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.535750] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb is going to be created. [ 647.627120] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.627486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.628102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.628102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.628367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.660088] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb in Status: IN_PROGRESS for 2s [ 648.109839] env[69274]: INFO networking_nsxv3.common.synchronization [req-3cada99c-1bfe-4e7f-93d1-1bbd1d5fa3b6 req-0139761c-7226-418b-8944-909967df6b4b service nova] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_rules [ 648.110140] env[69274]: INFO networking_nsxv3.common.synchronization [req-3cada99c-1bfe-4e7f-93d1-1bbd1d5fa3b6 req-0139761c-7226-418b-8944-909967df6b4b service nova] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_members [ 648.110299] env[69274]: INFO networking_nsxv3.common.synchronization [req-3cada99c-1bfe-4e7f-93d1-1bbd1d5fa3b6 req-0139761c-7226-418b-8944-909967df6b4b service nova] Enqueued Resource ID: d7182cce-17f9-40a8-8edb-ae992a459c6d with Priority: HIGHEST for action port [ 648.110557] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_rules [ 648.110694] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_members [ 648.110793] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7182cce-17f9-40a8-8edb-ae992a459c6d with Priority: HIGHEST for action port [ 648.115723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.115723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.115723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.115723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.115723] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.116727] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.116727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.116727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.116727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.117180] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.117180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.117180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.117396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.117487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.117583] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.118456] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7182cce-17f9-40a8-8edb-ae992a459c6d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.118561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.118621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.118772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.118844] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7182cce-17f9-40a8-8edb-ae992a459c6d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.437019] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: SUCCESS [ 648.437297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.584571] env[69274]: INFO networking_nsxv3.common.synchronization [req-22c9c7c6-8a64-414a-ba5a-1781f5d4ae92 req-6ff758cb-6aa6-489d-9fda-bb84552fe268 tempest-ListServersNegativeTestJSON-719866848 tempest-ListServersNegativeTestJSON-719866848-project-member] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 648.585215] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 648.585615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.585721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.585721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.586997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.587072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.587197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.587249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.587426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.588806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.589056] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.621123] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.624160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.624160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.624160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7182cce-17f9-40a8-8edb-ae992a459c6d with status ACTIVE [ 648.624160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.624160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.624160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.624160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.624160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.626101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.626101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.626101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.626101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.626101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.626101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.626101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.626101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.626402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.626402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.626402] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7182cce-17f9-40a8-8edb-ae992a459c6d is going to be updated. [ 648.653444] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.653871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.655542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.655542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.655542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.655542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7182cce-17f9-40a8-8edb-ae992a459c6d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.026893] env[69274]: INFO networking_nsxv3.common.synchronization [req-205dd63f-b5c5-4c5f-a08f-90b14612baab req-aa39bc1d-dcae-4afb-a1c2-156ef24b1981 tempest-ListImageFiltersTestJSON-1188695543 tempest-ListImageFiltersTestJSON-1188695543-project-member] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 649.027556] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 649.027987] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.031367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.031367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.031367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.031367] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.031367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.031367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.031367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.031367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.031367] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.092735] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.129248] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.205232] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.205232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.205232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.205232] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.484502] env[69274]: INFO networking_nsxv3.common.synchronization [req-14379fb3-4e94-425e-b651-3e8d58f5aca8 req-980b15f7-4ced-4caa-8f84-1f741f19194c tempest-ListServersNegativeTestJSON-719866848 tempest-ListServersNegativeTestJSON-719866848-project-member] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 649.485152] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGHEST for action security_group_members [ 649.485595] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.485748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.532210] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.532793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.533764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.535300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.535300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.535300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.535300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.537263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.537603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.537705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.537819] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 already deleted. [ 649.537912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.597825] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.636909] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.636909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.636909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.636909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.636909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.636909] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 is going to be created. [ 649.663375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.663708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.663708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.664015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.664015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.679742] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb in Status: SUCCESS [ 649.679929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.680872] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: UNINITIALIZED for 2s [ 649.713351] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.713583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.713663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.713966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.714220] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.714344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.714414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.714593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.714687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.714795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.714938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.715331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.715331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.715454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.715544] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.715643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.715707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.715855] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.715966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.716592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.716709] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.749458] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.749674] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.749899] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.750349] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.753743] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.754104] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.754309] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.754656] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.754830] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.755135] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.755324] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.755461] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.755578] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.755736] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.755964] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.756426] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.779199] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.779419] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.779587] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.779748] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.780217] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.780436] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.780567] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.780921] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.781254] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc846b4-e70a-420f-b1fb-7485ea0a74fb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.102716] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.102716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.102716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.102716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.102716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.102716] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 650.143480] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.143480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.143480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.143480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.143480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.153908] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 650.219609] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa3cd7b-c562-43e1-96fe-99002d55eac1: rpc.has_security_group_logging(os_id): False [ 650.253920] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.254125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.254195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.254389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.254480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.254705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.254804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.254873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.255063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.255145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.255335] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.255434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.255615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.255702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.255702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.256527] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.256527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.256527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.256527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.256527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.256762] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be created. [ 650.284017] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.284518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.284837] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.285120] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.285497] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.285738] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 7bc846b4-e70a-420f-b1fb-7485ea0a74fb not found, creating... [ 650.286303] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.286460] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.287196] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.287670] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.287808] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.288306] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.288560] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.288741] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.290481] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.290481] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.290481] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 7bc846b4-e70a-420f-b1fb-7485ea0a74fb is going to be created. [ 650.326240] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.326240] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.326240] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.326430] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.326771] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.326771] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.368520] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.368520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.368520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.368520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.368520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.384258] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: IN_PROGRESS for 2s [ 650.579687] env[69274]: INFO networking_nsxv3.common.synchronization [req-3ee4be7e-49de-42e5-b86e-859dd33bbf8e req-857a6a98-d436-4b61-83f2-5be7e2b9d992 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 650.581436] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 650.581823] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.581990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.582744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.582744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.582744] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.582744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.582744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.583209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.583368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.583507] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.085665] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.086069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.086069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.086202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.086294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.086549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.086684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.086760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.087344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.087447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.087546] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 651.119552] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.119552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.119552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.119552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.120157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.130430] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 651.206593] env[69274]: INFO networking_nsxv3.common.synchronization [None req-2cf72469-7974-4657-b25f-dff5ef3802f1 None None] Enqueued Resource ID: 2bfc28ea-f4b4-49d7-80fd-649fe39e1caf with Priority: HIGHEST for action port [ 651.207182] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bfc28ea-f4b4-49d7-80fd-649fe39e1caf with Priority: HIGHEST for action port [ 651.207509] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bfc28ea-f4b4-49d7-80fd-649fe39e1caf taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.207641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bfc28ea-f4b4-49d7-80fd-649fe39e1caf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.207722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bfc28ea-f4b4-49d7-80fd-649fe39e1caf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.207990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bfc28ea-f4b4-49d7-80fd-649fe39e1caf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.209816] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bfc28ea-f4b4-49d7-80fd-649fe39e1caf',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.375339] env[69274]: INFO networking_nsxv3.common.synchronization [req-205dd63f-b5c5-4c5f-a08f-90b14612baab req-9c8b698a-a638-45ca-83a8-3465050e8998 service nova] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_rules [ 651.375339] env[69274]: INFO networking_nsxv3.common.synchronization [req-205dd63f-b5c5-4c5f-a08f-90b14612baab req-9c8b698a-a638-45ca-83a8-3465050e8998 service nova] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 651.375339] env[69274]: INFO networking_nsxv3.common.synchronization [req-205dd63f-b5c5-4c5f-a08f-90b14612baab req-9c8b698a-a638-45ca-83a8-3465050e8998 service nova] Enqueued Resource ID: 7bc846b4-e70a-420f-b1fb-7485ea0a74fb with Priority: HIGHEST for action port [ 651.375594] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_rules [ 651.375750] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 651.375750] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc846b4-e70a-420f-b1fb-7485ea0a74fb with Priority: HIGHEST for action port [ 651.379912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.380192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.380289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.380601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.380666] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.382036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.382036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.382036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.382392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.382472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.382526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.382580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.382727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.382817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.382915] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.384901] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.384901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.384901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.385106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.385332] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc846b4-e70a-420f-b1fb-7485ea0a74fb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.693762] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: SUCCESS [ 651.695274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.695483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.695726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.695930] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.696109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.696184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.696420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.696487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.696581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.696671] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.712761] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bfc28ea-f4b4-49d7-80fd-649fe39e1caf [ 651.714977] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.714977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.714977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.714977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.714977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.714977] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bfc28ea-f4b4-49d7-80fd-649fe39e1caf already deleted. [ 651.714977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bfc28ea-f4b4-49d7-80fd-649fe39e1caf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.886867] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.887095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.887744] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.890671] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bc846b4-e70a-420f-b1fb-7485ea0a74fb with status ACTIVE [ 651.891256] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.891512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.891808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.892301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.895101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.895101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.895101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.895101] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bc846b4-e70a-420f-b1fb-7485ea0a74fb is going to be updated. [ 651.921277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.924170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.924170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.924170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.924170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.924170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bc846b4-e70a-420f-b1fb-7485ea0a74fb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.168760] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 652.168760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.168760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.168760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.168760] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.168760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.169212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.169212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.169212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.169212] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.198983] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.391167] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.404096] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 652.404096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.676674] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.677825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.677825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.677825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.677825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.678113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.678192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.678192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.678709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.678709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.678709] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be updated. [ 652.700964] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7: rpc.has_security_group_logging(os_id): False [ 652.725704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.725884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.725956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.726250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.726679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.726996] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.727155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.727223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.727425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.727510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.727623] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 is going to be created. [ 652.731046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.731180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.731257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.731482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.731658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.750764] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: IN_PROGRESS for 2s [ 652.893304] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.893504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.893566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.893835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.894052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.897071] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.898542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.898542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.898542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.898542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.898542] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be created. [ 652.916842] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: IN_PROGRESS for 2s [ 652.931916] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.932102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.932186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.932427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.932624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.953478] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: UNINITIALIZED for 2s [ 653.146137] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 653.146321] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 653.146437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.551289] env[69274]: INFO networking_nsxv3.common.synchronization [None req-88316055-a73b-4e93-ad0d-c70ac1533b5a None None] Enqueued Resource ID: 5a6b740b-db56-4d8d-8799-84da82fd5ba9 with Priority: HIGHEST for action port [ 653.551627] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a6b740b-db56-4d8d-8799-84da82fd5ba9 with Priority: HIGHEST for action port [ 653.552169] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a6b740b-db56-4d8d-8799-84da82fd5ba9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.552297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a6b740b-db56-4d8d-8799-84da82fd5ba9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.552412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a6b740b-db56-4d8d-8799-84da82fd5ba9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.552697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a6b740b-db56-4d8d-8799-84da82fd5ba9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.552778] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a6b740b-db56-4d8d-8799-84da82fd5ba9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.774289] env[69274]: INFO networking_nsxv3.common.synchronization [None req-2bc95157-f146-4f03-bc0a-844d188a8215 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 653.774289] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 653.774375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.774442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.774500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.775422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.775735] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.970291] env[69274]: INFO networking_nsxv3.common.synchronization [req-ad0cee67-aeaa-479f-a83a-9ef54a22dde5 req-d2a77213-28be-4c89-a59b-e0077dfdf8df tempest-AttachInterfacesV270Test-268404953 tempest-AttachInterfacesV270Test-268404953-project-member] Enqueued Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_members [ 653.972712] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_members [ 653.973493] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.973987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.976862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.976862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.976862] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.976862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.976862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.976862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.976862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.976862] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.056929] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a6b740b-db56-4d8d-8799-84da82fd5ba9 [ 654.057197] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.057338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.057411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.057628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.057720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.057813] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a6b740b-db56-4d8d-8799-84da82fd5ba9 already deleted. [ 654.057896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a6b740b-db56-4d8d-8799-84da82fd5ba9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.094418] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3e0519be-970b-40a2-80c5-2b7c1f3c6bb1 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 654.094888] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 654.095644] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.095834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.300448] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.300622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.300921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.301737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.301829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.302102] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 already deleted. [ 654.302102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.304417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.304417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.304417] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.481950] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.481950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.481950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.481950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.481950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.481950] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.483544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.483544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.483544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.485240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.485240] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1c3475-4204-4218-9478-83b2e1605cd7 already deleted. [ 654.485240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.503160] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-990 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.503309] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-990" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.503467] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-990" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.504036] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-990" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.505464] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.505464] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.505464] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.505672] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.506374] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.506374] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.506374] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.506374] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.506712] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.507097] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.507097] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.507292] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.529201] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.529523] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.529751] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.530019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-990" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.530763] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.530763] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.530763] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.533796] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.533796] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6188e6ce-3859-4cac-93b4-2b0d1e17fb68',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.761432] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a499f7e4-147f-443a-94fe-27f18e7a8418 in Status: SUCCESS [ 654.762389] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 deletion is rescheduled due to dependency. [ 654.762389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.828655] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.828655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.828655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.828655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.828655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.828655] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 already deleted. [ 654.828655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.928805] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: SUCCESS [ 654.928805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.963599] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: SUCCESS [ 654.964294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.965160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.965474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.965724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.966387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.966509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.966721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.966844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.966950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.967057] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.038570] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.038785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.038918] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.040160] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.040160] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.040160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 6188e6ce-3859-4cac-93b4-2b0d1e17fb68 not found, creating... [ 655.040160] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.040160] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.040160] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.040441] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.040521] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.041615] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.041615] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.041615] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.041615] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.041615] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.041615] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 6188e6ce-3859-4cac-93b4-2b0d1e17fb68 is going to be created. [ 655.063109] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.063307] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.063559] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.063771] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.064041] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.064317] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.474429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.474429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.474429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.474429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.474429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.475034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.475034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.475034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.475034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.475034] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.978990] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc07b7c1-15e8-4533-9f0f-5fb201ac07b7: rpc.has_security_group_logging(os_id): False [ 656.007216] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.007390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.007467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.007651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.007735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.007930] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.008036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.008123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.008248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.008333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.008596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.008684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.008684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.008842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.008893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.011252] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.011252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.011252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.011252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.011252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.011252] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be created. [ 656.022920] env[69274]: INFO networking_nsxv3.common.synchronization [req-ad0cee67-aeaa-479f-a83a-9ef54a22dde5 req-53500b95-113e-4beb-bf40-442ac24b03a3 service nova] Enqueued Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_rules [ 656.023075] env[69274]: INFO networking_nsxv3.common.synchronization [req-ad0cee67-aeaa-479f-a83a-9ef54a22dde5 req-53500b95-113e-4beb-bf40-442ac24b03a3 service nova] Enqueued Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_members [ 656.023200] env[69274]: INFO networking_nsxv3.common.synchronization [req-ad0cee67-aeaa-479f-a83a-9ef54a22dde5 req-53500b95-113e-4beb-bf40-442ac24b03a3 service nova] Enqueued Resource ID: 6188e6ce-3859-4cac-93b4-2b0d1e17fb68 with Priority: HIGHEST for action port [ 656.023584] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_rules [ 656.023584] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_members [ 656.023716] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6188e6ce-3859-4cac-93b4-2b0d1e17fb68 with Priority: HIGHEST for action port [ 656.024247] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.026740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.026740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.026740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.026740] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.027617] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.027747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.027817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.028393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.029124] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.029124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.029124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.029124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.029310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.029754] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.032728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.034676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.034676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.034676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.034676] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6188e6ce-3859-4cac-93b4-2b0d1e17fb68',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.099460] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.099705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.099835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.100185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.100393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.116014] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: IN_PROGRESS for 2s [ 656.536746] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.536919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.537116] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.538078] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6188e6ce-3859-4cac-93b4-2b0d1e17fb68 with status ACTIVE [ 656.538274] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.538401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.538469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.539529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.539529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.539529] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.539529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.539529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.539529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.539529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.539529] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.539910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.539910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.539910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.539910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.539910] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6188e6ce-3859-4cac-93b4-2b0d1e17fb68 is going to be updated. [ 656.567130] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.569190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.569190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.569190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.569190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.569190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6188e6ce-3859-4cac-93b4-2b0d1e17fb68" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.891294] env[69274]: INFO networking_nsxv3.common.synchronization [req-5330bb0a-9023-4480-a50e-362b10f105a6 req-7a361a19-b0bb-4b82-8872-523abd25d26f tempest-ServersNegativeTestJSON-1840850554 tempest-ServersNegativeTestJSON-1840850554-project-member] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 656.891931] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 656.892324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.892497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.892551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.892773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.892949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.893286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.893377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.893554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.894478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.894478] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.043596] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.397625] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.399109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.399109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.399225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.399266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.399550] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.399682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.399747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.399940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.400032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.400851] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d already deleted. [ 657.400851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.545796] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.548543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.548543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.548543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.548715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.548715] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1c3475-4204-4218-9478-83b2e1605cd7 is going to be created. [ 657.583879] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.584408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.584408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.584530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.586304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.604408] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da1c3475-4204-4218-9478-83b2e1605cd7 in Status: UNINITIALIZED for 2s [ 657.683091] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.683091] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.683091] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.683091] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.683091] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.683091] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.683739] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.684173] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.684518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.684990] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.687694] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.687694] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.687694] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.687694] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.687694] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.687694] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.727665] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.727665] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.727665] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.727665] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.727665] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b18f49b1-da80-4541-a74c-f149458a21d7 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.732028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.732028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.732028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.732028] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18f49b1-da80-4541-a74c-f149458a21d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.130512] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: SUCCESS [ 658.130512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.237086] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.237086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b18f49b1-da80-4541-a74c-f149458a21d7 not found, creating... [ 658.237086] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.237086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.237677] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.237677] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.237677] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.237677] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.237677] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.237677] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b18f49b1-da80-4541-a74c-f149458a21d7 is going to be created. [ 658.275509] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.275509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.275509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.275509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.275509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.275509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.412452] env[69274]: INFO networking_nsxv3.common.synchronization [None req-4d6d03cd-d29f-4d14-8a47-3be6484b168e None None] Enqueued Resource ID: e280944e-837c-412f-9c3f-baf3d6e87d88 with Priority: HIGHEST for action port [ 659.413133] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e280944e-837c-412f-9c3f-baf3d6e87d88 with Priority: HIGHEST for action port [ 659.413511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-e280944e-837c-412f-9c3f-baf3d6e87d88 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.413654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e280944e-837c-412f-9c3f-baf3d6e87d88" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.413714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e280944e-837c-412f-9c3f-baf3d6e87d88" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.413975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e280944e-837c-412f-9c3f-baf3d6e87d88" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.415320] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e280944e-837c-412f-9c3f-baf3d6e87d88',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.617931] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da1c3475-4204-4218-9478-83b2e1605cd7 in Status: SUCCESS [ 659.618787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.618939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.619788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.619788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.619788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.619788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.620253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.620361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.620503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.620639] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.861245] env[69274]: INFO networking_nsxv3.common.synchronization [req-5330bb0a-9023-4480-a50e-362b10f105a6 req-3670e670-11a4-4a04-8988-4e6835f46409 service nova] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_rules [ 659.861429] env[69274]: INFO networking_nsxv3.common.synchronization [req-5330bb0a-9023-4480-a50e-362b10f105a6 req-3670e670-11a4-4a04-8988-4e6835f46409 service nova] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 659.861566] env[69274]: INFO networking_nsxv3.common.synchronization [req-5330bb0a-9023-4480-a50e-362b10f105a6 req-3670e670-11a4-4a04-8988-4e6835f46409 service nova] Enqueued Resource ID: b18f49b1-da80-4541-a74c-f149458a21d7 with Priority: HIGHEST for action port [ 659.862075] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_rules [ 659.862207] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 659.862305] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b18f49b1-da80-4541-a74c-f149458a21d7 with Priority: HIGHEST for action port [ 659.863609] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.863770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.863851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.864108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.864207] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.866556] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.866556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.866556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.867165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.867165] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.867165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.867165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.867494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.867494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.867494] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.868306] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b18f49b1-da80-4541-a74c-f149458a21d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.868440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.868954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.868954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.868954] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18f49b1-da80-4541-a74c-f149458a21d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.917082] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e280944e-837c-412f-9c3f-baf3d6e87d88 [ 659.917364] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.917518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.917589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.917804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.917898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.917996] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e280944e-837c-412f-9c3f-baf3d6e87d88 already deleted. [ 659.918111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e280944e-837c-412f-9c3f-baf3d6e87d88" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.124621] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.124621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.124621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.124621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.124621] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.124621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.124964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.124964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.124964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.125077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.125181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.125281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.125343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.125488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.125622] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.125713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.125774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.125915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.125992] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.126088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.126621] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.367023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.367161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.371735] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.375152] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b18f49b1-da80-4541-a74c-f149458a21d7 with status ACTIVE [ 660.375152] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.375152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.375152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.375152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.375152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.375152] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.375651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.375651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.375651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.375651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.375958] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.375958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.375958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.377589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.377774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.377897] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b18f49b1-da80-4541-a74c-f149458a21d7 is going to be updated. [ 660.405612] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.406528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.407506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.408271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.408434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.409168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.630863] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da1c3475-4204-4218-9478-83b2e1605cd7: rpc.has_security_group_logging(os_id): False [ 660.647472] env[69274]: INFO networking_nsxv3.common.synchronization [req-e8918926-278b-4a46-b13d-097f5fdf6150 req-19169b49-c8a6-4be5-a3d2-2f027a17a58f tempest-ImagesNegativeTestJSON-1495151409 tempest-ImagesNegativeTestJSON-1495151409-project-member] Enqueued Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_members [ 660.649034] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.649290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.649430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.649745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.649921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.650329] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.650885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.650885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.650885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.650885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.651187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.651361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.651463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.651653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.651786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.652037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.652250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.652363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.652561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.652681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.652814] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da1c3475-4204-4218-9478-83b2e1605cd7 is going to be created. [ 660.655515] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_members [ 660.656029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.656200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.656335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.656687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.656907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.657079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.657701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.657954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.658186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.658436] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.733727] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.733727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.733727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.733727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.733727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.746872] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da1c3475-4204-4218-9478-83b2e1605cd7 in Status: IN_PROGRESS for 2s [ 660.881494] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.164583] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.164762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.164833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.165862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.166025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.166244] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.166354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.166416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.166592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.166670] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.166772] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d already deleted. [ 661.166854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.383799] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.384359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.384750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.385173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.385637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.386392] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be created. [ 661.416904] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.416904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.416904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.416904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.416904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.431363] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: UNINITIALIZED for 2s [ 661.485014] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-579 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.485235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-579" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.485366] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-579" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.485686] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-579" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.485951] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.486122] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.486242] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.486457] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.486599] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.486829] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.486946] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.487074] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.487213] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.487410] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 661.487500] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.487637] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.508113] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.508298] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 661.508442] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.508628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-579" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.508948] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b0e43125-7464-4058-a4a0-074a95ec6652 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.509141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.509266] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.509593] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.510013] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e43125-7464-4058-a4a0-074a95ec6652',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.664944] env[69274]: INFO networking_nsxv3.common.synchronization [None req-d067167b-da72-44fc-b61b-8ad91edac9cc tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 661.665616] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 661.665876] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.666366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.666366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.666527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.666666] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.756450] env[69274]: INFO networking_nsxv3.common.synchronization [None req-411daea3-e2e2-4e6f-9cd1-075e8fad74b9 tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 661.756672] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 661.756996] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.757136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.015346] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.015346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.015346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.015346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.015346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.015346] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b0e43125-7464-4058-a4a0-074a95ec6652 not found, creating... [ 662.015346] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.015346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.015346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.015346] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.016208] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.016579] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.016765] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.016892] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.019475] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.019475] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.019475] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b0e43125-7464-4058-a4a0-074a95ec6652 is going to be created. [ 662.042876] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.042876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.042876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.042876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.042876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.042876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.100742] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7663da41-99ae-4109-aead-0938a55e83d7 None None] Enqueued Resource ID: 4e554b24-d6f3-42b5-b709-27f991cf1bf0 with Priority: HIGHEST for action port [ 662.101639] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e554b24-d6f3-42b5-b709-27f991cf1bf0 with Priority: HIGHEST for action port [ 662.102020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e554b24-d6f3-42b5-b709-27f991cf1bf0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.102402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e554b24-d6f3-42b5-b709-27f991cf1bf0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.102402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e554b24-d6f3-42b5-b709-27f991cf1bf0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.102632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e554b24-d6f3-42b5-b709-27f991cf1bf0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.102724] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e554b24-d6f3-42b5-b709-27f991cf1bf0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.200279] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.200279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.200279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.200279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.200279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.200279] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 already deleted. [ 662.200279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.200279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.200279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.200279] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.606535] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e554b24-d6f3-42b5-b709-27f991cf1bf0 [ 662.606886] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.607099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.607184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.607447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.607644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.607689] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e554b24-d6f3-42b5-b709-27f991cf1bf0 already deleted. [ 662.607960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e554b24-d6f3-42b5-b709-27f991cf1bf0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.723488] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.724140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.724140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.724140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.724140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.724500] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 already deleted. [ 662.724500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.773277] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da1c3475-4204-4218-9478-83b2e1605cd7 in Status: SUCCESS [ 662.773277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.852962] env[69274]: INFO networking_nsxv3.common.synchronization [req-e8918926-278b-4a46-b13d-097f5fdf6150 req-de2aeda2-7085-4c1f-b318-07e61ea12d8a service nova] Enqueued Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_rules [ 662.852962] env[69274]: INFO networking_nsxv3.common.synchronization [req-e8918926-278b-4a46-b13d-097f5fdf6150 req-de2aeda2-7085-4c1f-b318-07e61ea12d8a service nova] Enqueued Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_members [ 662.852962] env[69274]: INFO networking_nsxv3.common.synchronization [req-e8918926-278b-4a46-b13d-097f5fdf6150 req-de2aeda2-7085-4c1f-b318-07e61ea12d8a service nova] Enqueued Resource ID: b0e43125-7464-4058-a4a0-074a95ec6652 with Priority: HIGHEST for action port [ 662.852962] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_rules [ 662.852962] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_members [ 662.852962] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0e43125-7464-4058-a4a0-074a95ec6652 with Priority: HIGHEST for action port [ 662.852962] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.853300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.853436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.853724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.853819] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.855648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.855761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.855825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.856067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.856201] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.856349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.856439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.856644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.856761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.857071] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.864628] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0e43125-7464-4058-a4a0-074a95ec6652 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.864628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.864628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.864628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.864628] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0e43125-7464-4058-a4a0-074a95ec6652',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.356637] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.356637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.359815] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.362672] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0e43125-7464-4058-a4a0-074a95ec6652 with status ACTIVE [ 663.362878] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.363041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.363106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.365211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.365211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.366347] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.366347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.366347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.366347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.366347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.366559] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.366772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.366772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.367030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.367170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.367321] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0e43125-7464-4058-a4a0-074a95ec6652 is going to be updated. [ 663.394021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.394169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.394242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.394451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.394587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.394749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0e43125-7464-4058-a4a0-074a95ec6652" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.444534] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 663.444887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.446335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.446651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.446937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.447200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.447341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.447611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.447774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.447937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.448147] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.862934] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.951457] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.951625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.951682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.952039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.952251] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.952367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.952435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.952608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.952698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.953027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.953027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.953144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.953144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.953248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.953386] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.953477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.955019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.955019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.955019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.955019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.955019] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.366399] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.366684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.366758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.367024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.367119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.367256] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d is going to be created. [ 664.393860] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.394706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.395263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.396200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.396397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.410528] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d in Status: UNINITIALIZED for 2s [ 664.462026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df948508-d1d6-4368-979c-297ed94dda9d: rpc.has_security_group_logging(os_id): False [ 664.481556] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.481781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.481861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.482214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.482623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.482987] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.483313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.483468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.483738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.483881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.484159] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.484309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.484421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.484656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.484783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.485068] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.485290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.485399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.485624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.485760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.485881] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be created. [ 664.576176] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.576322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.576393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.576693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.577513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.591584] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 666.060161] env[69274]: INFO networking_nsxv3.common.synchronization [req-ab00c8fc-9e47-4465-94ad-5f3d22045940 req-03218d25-ae62-4493-8ecb-9279d82f8208 tempest-ListImageFiltersTestJSON-1188695543 tempest-ListImageFiltersTestJSON-1188695543-project-member] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 666.061853] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 666.062206] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.062332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.062412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.062601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.062752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.062857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.062920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.063082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.063170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.063267] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.421034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d in Status: SUCCESS [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.423016] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.423016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.423016] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.567410] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.606592] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 666.606897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.624685] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.624685] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.624842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.625127] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.625979] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.626246] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.626420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.626743] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.627074] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.627432] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.627619] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.627785] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.627969] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.628278] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.628618] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.628618] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.649594] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.650007] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.650007] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.650234] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.650688] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.650889] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.651053] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.651642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.651973] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09880eab-c9c7-4a6c-9a0b-173ed87c4bdd',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.745305] env[69274]: INFO networking_nsxv3.common.synchronization [None req-e5965fe2-15d6-4e0d-a58f-17208509dde4 None None] Enqueued Resource ID: ebe69f09-d967-4c8b-8fb2-4d6612f90a9d with Priority: HIGHEST for action port [ 666.745305] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe69f09-d967-4c8b-8fb2-4d6612f90a9d with Priority: HIGHEST for action port [ 666.745898] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebe69f09-d967-4c8b-8fb2-4d6612f90a9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.746048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebe69f09-d967-4c8b-8fb2-4d6612f90a9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.746128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebe69f09-d967-4c8b-8fb2-4d6612f90a9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.746409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebe69f09-d967-4c8b-8fb2-4d6612f90a9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.746506] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe69f09-d967-4c8b-8fb2-4d6612f90a9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.929023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.929023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.929023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.929023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.929023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.929650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.929650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.929650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.929650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.929650] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.071958] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.154841] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.155091] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.155225] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.155641] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.155820] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.155988] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 09880eab-c9c7-4a6c-9a0b-173ed87c4bdd not found, creating... [ 667.156651] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.156896] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.157086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.157607] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.157790] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.158177] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.158463] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.158675] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.158957] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.159118] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.159357] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 09880eab-c9c7-4a6c-9a0b-173ed87c4bdd is going to be created. [ 667.185930] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.186625] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.186861] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.187203] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.187687] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.187986] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.249603] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebe69f09-d967-4c8b-8fb2-4d6612f90a9d [ 667.250144] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.250370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.250469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.250714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.250815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.250919] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebe69f09-d967-4c8b-8fb2-4d6612f90a9d already deleted. [ 667.251024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebe69f09-d967-4c8b-8fb2-4d6612f90a9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.432543] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c94ec27d-b5d9-4029-8581-29e1a1f41d8d: rpc.has_security_group_logging(os_id): False [ 667.453143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.453143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.453143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.453143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.453143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.453432] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.453432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.453499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.453659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.453738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.453931] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.454036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.454102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.454247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.454326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.454514] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.454608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.454671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.454811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.454888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.454982] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d is going to be created. [ 667.515043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.515823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.515823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.515823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.515823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.527350] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d in Status: IN_PROGRESS for 2s [ 667.573725] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.573840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.573940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.574211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.574309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.574407] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be updated. [ 667.635538] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.635704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.635704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.635875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.635996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.646733] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: IN_PROGRESS for 2s [ 667.953857] env[69274]: INFO networking_nsxv3.common.synchronization [req-ab00c8fc-9e47-4465-94ad-5f3d22045940 req-59015934-f980-4e25-b4d5-0b4da6f3b80e service nova] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_rules [ 667.954064] env[69274]: INFO networking_nsxv3.common.synchronization [req-ab00c8fc-9e47-4465-94ad-5f3d22045940 req-59015934-f980-4e25-b4d5-0b4da6f3b80e service nova] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 667.954225] env[69274]: INFO networking_nsxv3.common.synchronization [req-ab00c8fc-9e47-4465-94ad-5f3d22045940 req-59015934-f980-4e25-b4d5-0b4da6f3b80e service nova] Enqueued Resource ID: 09880eab-c9c7-4a6c-9a0b-173ed87c4bdd with Priority: HIGHEST for action port [ 667.954847] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_rules [ 667.955344] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 667.955705] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09880eab-c9c7-4a6c-9a0b-173ed87c4bdd with Priority: HIGHEST for action port [ 667.956036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.956163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.956230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.956677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.956677] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.958014] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.958221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.958449] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.958562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.958645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.958820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.958904] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09880eab-c9c7-4a6c-9a0b-173ed87c4bdd',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.462077] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09880eab-c9c7-4a6c-9a0b-173ed87c4bdd with status ACTIVE [ 668.462461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.462461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.462624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.462895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.462895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.463059] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.463167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.463344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.463416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.463461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.463642] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.463778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.463859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.464100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.464197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.464327] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09880eab-c9c7-4a6c-9a0b-173ed87c4bdd is going to be updated. [ 668.466467] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.466605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.490961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.490961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.490961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.491273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.491445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.491578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09880eab-c9c7-4a6c-9a0b-173ed87c4bdd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.949487] env[69274]: INFO networking_nsxv3.common.synchronization [None req-2038c74a-6c72-4398-82ae-07e99a157f0e tempest-ServersTestManualDisk-1091924666 tempest-ServersTestManualDisk-1091924666-project-member] Enqueued Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_rules [ 668.950123] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_rules [ 668.950506] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.950707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.950746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.951252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.952019] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.002292] env[69274]: INFO networking_nsxv3.common.synchronization [None req-a88b9128-bbf1-4926-97f8-464bb653617f None None] Enqueued Resource ID: 5a5797ea-6433-4f3d-85bc-d84d96d6dce1 with Priority: HIGHEST for action port [ 669.003515] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a5797ea-6433-4f3d-85bc-d84d96d6dce1 with Priority: HIGHEST for action port [ 669.004589] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a5797ea-6433-4f3d-85bc-d84d96d6dce1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.004765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a5797ea-6433-4f3d-85bc-d84d96d6dce1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.004840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a5797ea-6433-4f3d-85bc-d84d96d6dce1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.005132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a5797ea-6433-4f3d-85bc-d84d96d6dce1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.005224] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a5797ea-6433-4f3d-85bc-d84d96d6dce1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.070022] env[69274]: INFO networking_nsxv3.common.synchronization [None req-89ec408f-51e1-4acc-b07d-79feb28c6dea tempest-ServersTestManualDisk-1091924666 tempest-ServersTestManualDisk-1091924666-project-member] Enqueued Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_rules [ 669.070022] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_rules [ 669.070145] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.070370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.476275] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.476975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.480530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.480530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.480530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.480530] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 already deleted. [ 669.480530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.480530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.480530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.480530] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.511447] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a5797ea-6433-4f3d-85bc-d84d96d6dce1 [ 669.511447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.511447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.511447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.511447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.511447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.511447] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a5797ea-6433-4f3d-85bc-d84d96d6dce1 already deleted. [ 669.511447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a5797ea-6433-4f3d-85bc-d84d96d6dce1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.539838] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d in Status: SUCCESS [ 669.539838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.584365] env[69274]: INFO networking_nsxv3.common.synchronization [None req-f08881ca-a790-49a2-9896-b82ce338b215 tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c with Priority: HIGHEST for action security_group_rules [ 669.585421] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c with Priority: HIGHEST for action security_group_rules [ 669.586036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.586987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.587460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.587851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.588127] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.659861] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: SUCCESS [ 669.659861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.659861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.659861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.659861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.659861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.659861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.659861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.659861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.659861] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.708040] env[69274]: INFO networking_nsxv3.common.synchronization [None req-45bf1f4e-242c-44c5-bdb5-0c049b2d1411 tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c with Priority: HIGHEST for action security_group_rules [ 669.709220] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c with Priority: HIGHEST for action security_group_rules [ 669.709220] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.709220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.008655] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.008927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.009086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.009357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.009462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.009586] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 already deleted. [ 670.009682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.116057] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.116057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.116057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.116057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.116057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.116057] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c already deleted. [ 670.116057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.116057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.116057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.116057] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.161503] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.637987] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.638404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.638404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.638528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.638627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.638728] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c already deleted. [ 670.638814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4d9e835-bfb5-45dc-ae82-db6bb3d51a5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.664339] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.169261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.169261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.169261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.169261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.169261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.169261] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be updated. [ 671.206218] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.206218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.206218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.206218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.206218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.221544] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: IN_PROGRESS for 2s [ 673.235143] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: SUCCESS [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.237597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.237597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.237597] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.305022] env[69274]: INFO networking_nsxv3.common.synchronization [req-27fcb7dc-a6d7-45fc-a309-3d721f6a7636 req-c0cb33cf-7a52-44f0-9340-7e9b79b2083c tempest-AttachInterfacesV270Test-268404953 tempest-AttachInterfacesV270Test-268404953-project-member] Enqueued Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_members [ 673.305268] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGHEST for action security_group_members [ 673.305586] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.305843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.305843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.306025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.306208] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.306309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.308490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.308490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.308490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.308490] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.740031] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.742877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.742877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.742877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.742877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.743517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.743517] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.810510] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.810510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.810734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.810816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.810885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.811103] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.811201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.811261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.811415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.811510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.811566] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1c3475-4204-4218-9478-83b2e1605cd7 is going to be updated. [ 673.843108] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.843108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.843108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.843108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.843108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.853074] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da1c3475-4204-4218-9478-83b2e1605cd7 in Status: IN_PROGRESS for 2s [ 674.245935] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc07b7c1-15e8-4533-9f0f-5fb201ac07b7: rpc.has_security_group_logging(os_id): False [ 674.265663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.266025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.266253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.266799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.267011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.267358] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.267554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.267683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.267909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.268101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.268486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.268649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.268779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.269019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.269321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.269632] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.269812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.269934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.270158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.270322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.270477] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be updated. [ 674.343710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.343898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.343941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.344181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.344369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.358169] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: IN_PROGRESS for 2s [ 674.854781] env[69274]: INFO networking_nsxv3.common.synchronization [req-52c727c5-59fb-413c-9128-e145000d77a3 req-a8aa95e0-093d-4aa8-a1d8-9db22bc19286 tempest-ImagesNegativeTestJSON-1495151409 tempest-ImagesNegativeTestJSON-1495151409-project-member] Enqueued Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_members [ 674.855315] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGHEST for action security_group_members [ 674.855619] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.859369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.859502] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.859762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.859942] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.860075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.860156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.860295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.860510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.860510] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.956913] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa91c0aa-d951-4076-9eeb-a8b096f39316 req-115a55ba-4de8-4443-a765-320bf3c620b3 tempest-ServerExternalEventsTest-1174317524 tempest-ServerExternalEventsTest-1174317524-project-member] Enqueued Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_members [ 674.957624] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_members [ 674.958199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.958395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.958504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.958930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.959192] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.959348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.959447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.959678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.959817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.959981] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.362463] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.362680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.362680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.363601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.363601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.363601] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.363601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.363601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.363601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.363601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.363601] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d is going to be updated. [ 675.394983] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.394983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.394983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.394983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.395367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.404036] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d in Status: IN_PROGRESS for 2s [ 675.452791] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.453039] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.453166] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.453485] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.453711] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.453882] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.454008] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.454375] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.454580] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.454842] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.454996] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.455160] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.455313] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.455474] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.455615] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.455781] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.467462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.467834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.468261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.469440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.469440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.472288] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.472288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.472288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.472494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.472580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.472706] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee already deleted. [ 675.472790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.478477] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.480687] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.480872] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.481084] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.481454] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-cee31fea-75d4-4ab2-a225-25fd0e0971a3 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.481646] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.481776] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.482661] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.482661] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cee31fea-75d4-4ab2-a225-25fd0e0971a3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.863679] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da1c3475-4204-4218-9478-83b2e1605cd7 in Status: SUCCESS [ 675.863679] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da1c3475-4204-4218-9478-83b2e1605cd7 deletion is rescheduled due to dependency. [ 675.863679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.893032] env[69274]: INFO networking_nsxv3.common.synchronization [None req-6b8bf70b-a150-42ed-8a05-86bbe58bcc46 None None] Enqueued Resource ID: df169479-2a68-475a-b9a5-b70bb86efc99 with Priority: HIGHEST for action port [ 675.893032] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df169479-2a68-475a-b9a5-b70bb86efc99 with Priority: HIGHEST for action port [ 675.893032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-df169479-2a68-475a-b9a5-b70bb86efc99 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.893032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df169479-2a68-475a-b9a5-b70bb86efc99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.893032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df169479-2a68-475a-b9a5-b70bb86efc99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.893032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df169479-2a68-475a-b9a5-b70bb86efc99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.893032] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df169479-2a68-475a-b9a5-b70bb86efc99',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.987100] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.987100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.987100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.987100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.987100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.987100] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port cee31fea-75d4-4ab2-a225-25fd0e0971a3 not found, creating... [ 675.987100] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.987100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.987579] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.987894] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.988606] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.989128] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.989513] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.989793] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.990311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.991141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.991141] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: cee31fea-75d4-4ab2-a225-25fd0e0971a3 is going to be created. [ 676.018037] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.020582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.020582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.020582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.020582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.020582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.376640] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: SUCCESS [ 676.376640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.396664] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df169479-2a68-475a-b9a5-b70bb86efc99 [ 676.396952] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.397313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.397452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.398154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.399448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.399587] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df169479-2a68-475a-b9a5-b70bb86efc99 already deleted. [ 676.399726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df169479-2a68-475a-b9a5-b70bb86efc99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.908041] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa91c0aa-d951-4076-9eeb-a8b096f39316 req-ecff7205-f502-470a-9c65-652aac08b332 service nova] Enqueued Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_rules [ 676.908156] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa91c0aa-d951-4076-9eeb-a8b096f39316 req-ecff7205-f502-470a-9c65-652aac08b332 service nova] Enqueued Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_members [ 676.908299] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa91c0aa-d951-4076-9eeb-a8b096f39316 req-ecff7205-f502-470a-9c65-652aac08b332 service nova] Enqueued Resource ID: cee31fea-75d4-4ab2-a225-25fd0e0971a3 with Priority: HIGHEST for action port [ 676.908958] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_rules [ 676.911366] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_members [ 676.911498] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee31fea-75d4-4ab2-a225-25fd0e0971a3 with Priority: HIGHEST for action port [ 676.911809] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.911948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.911996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.912280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.912371] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.913600] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.913729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.913796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.913990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.914158] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.914289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.914367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.914478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.914570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.914645] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.918058] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-cee31fea-75d4-4ab2-a225-25fd0e0971a3 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.918204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.918243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.918453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.918537] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cee31fea-75d4-4ab2-a225-25fd0e0971a3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.413806] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d in Status: SUCCESS [ 677.413806] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d deletion is rescheduled due to dependency. [ 677.413806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.420279] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.421367] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.421477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.421657] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cee31fea-75d4-4ab2-a225-25fd0e0971a3 with status ACTIVE [ 677.421812] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.421919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.422034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.422243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.422457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.423057] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.423057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.423057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.423057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.423057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.426560] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.426560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.426560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.426560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.426560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.426560] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cee31fea-75d4-4ab2-a225-25fd0e0971a3 is going to be updated. [ 677.447392] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.447392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.447392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.447392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.447392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.447392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cee31fea-75d4-4ab2-a225-25fd0e0971a3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.926362] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.407060] env[69274]: INFO networking_nsxv3.common.synchronization [None req-67cec70a-df10-4444-9bba-3d577b291647 None None] Enqueued Resource ID: 60d17468-b519-4b7b-9ac7-67c3250dcceb with Priority: HIGHEST for action port [ 678.408695] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60d17468-b519-4b7b-9ac7-67c3250dcceb with Priority: HIGHEST for action port [ 678.408695] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-60d17468-b519-4b7b-9ac7-67c3250dcceb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.408695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60d17468-b519-4b7b-9ac7-67c3250dcceb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.409366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60d17468-b519-4b7b-9ac7-67c3250dcceb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.409668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60d17468-b519-4b7b-9ac7-67c3250dcceb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.409759] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60d17468-b519-4b7b-9ac7-67c3250dcceb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.429950] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.430247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.430247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.430498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.430612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.430733] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee is going to be created. [ 678.461025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.461025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.461025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.461025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.461025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.472894] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee in Status: UNINITIALIZED for 2s [ 678.742550] env[69274]: INFO networking_nsxv3.common.synchronization [req-fbb3a3be-6c98-4f22-94e0-030ffd537eaf req-9c94f260-efca-4f2a-b0c1-1a6517c403c0 tempest-ServersWithSpecificFlavorTestJSON-7327972 tempest-ServersWithSpecificFlavorTestJSON-7327972-project-member] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 678.746342] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 678.747262] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.747461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.748179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.748503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.748754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.748905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.748999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.749258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.749431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.749598] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.915010] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60d17468-b519-4b7b-9ac7-67c3250dcceb [ 678.915285] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.915424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.915497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.915710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.915801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.915916] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60d17468-b519-4b7b-9ac7-67c3250dcceb already deleted. [ 678.916029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60d17468-b519-4b7b-9ac7-67c3250dcceb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.253101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.253101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.253101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.253319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.253903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.256596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.256596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.256596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.256864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.257505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.259467] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be updated. [ 679.301780] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.301904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.301958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.302163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.302313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.312095] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: IN_PROGRESS for 2s [ 680.485149] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee in Status: SUCCESS [ 680.485149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.485149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.485149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.485149] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.485149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.485149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.485149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.485792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.485792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.485792] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.988408] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.988408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.988408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.988712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.988962] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.989160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.989238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.989416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.990055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.990055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.990055] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.990055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.990055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.990287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.990287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.990408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.990488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.991747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.991747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.991747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.991747] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.326941] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 681.326941] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a deletion is rescheduled due to dependency. [ 681.326941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.493968] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee: rpc.has_security_group_logging(os_id): False [ 681.519033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.519033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.519033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.519033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.519563] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.519563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.519563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.521247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.521247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.521423] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee is going to be created. [ 681.600194] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.600375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.600459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.600660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.600846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.613605] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee in Status: IN_PROGRESS for 2s [ 683.627986] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee in Status: SUCCESS [ 683.628357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.747552] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 683.747722] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 686.685739] env[69274]: INFO networking_nsxv3.common.synchronization [req-e719832a-5337-4e01-8aca-7702f26516db req-05e4957c-f789-4cf7-b0d2-9dd8301b22f6 tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 686.686821] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 686.686821] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.686821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.686992] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.687171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.687331] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.687455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.687540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.687745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.687862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.688481] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.033840] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.034062] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.034196] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.034517] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.034799] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.034962] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.035093] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.035380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.035477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.035687] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.035810] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.035919] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.036982] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.036982] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.036982] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.036982] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.061011] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.061302] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.061842] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.061842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.062271] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b7ffefa0-427d-4f30-afad-219c8791cb81 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.062480] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.062636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.063059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.063221] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ffefa0-427d-4f30-afad-219c8791cb81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.190847] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.566340] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.566597] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.566694] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.567012] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.567176] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.567336] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b7ffefa0-427d-4f30-afad-219c8791cb81 not found, creating... [ 687.567615] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.567775] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.567898] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.568133] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.568273] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.568606] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.568775] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.568893] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.569118] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.569332] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.569535] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b7ffefa0-427d-4f30-afad-219c8791cb81 is going to be created. [ 687.591246] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.591544] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.591696] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.592032] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.592642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.592642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.693640] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.196466] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.196717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.196717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.196915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.197054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.197462] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 688.229507] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.229999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.229999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.230213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.230483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.242911] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 688.432229] env[69274]: INFO networking_nsxv3.common.synchronization [req-e719832a-5337-4e01-8aca-7702f26516db req-d110e04e-3356-407e-8d0b-f99b483952ec service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 688.432229] env[69274]: INFO networking_nsxv3.common.synchronization [req-e719832a-5337-4e01-8aca-7702f26516db req-d110e04e-3356-407e-8d0b-f99b483952ec service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 688.432229] env[69274]: INFO networking_nsxv3.common.synchronization [req-e719832a-5337-4e01-8aca-7702f26516db req-d110e04e-3356-407e-8d0b-f99b483952ec service nova] Enqueued Resource ID: b7ffefa0-427d-4f30-afad-219c8791cb81 with Priority: HIGHEST for action port [ 688.432229] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 688.432229] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 688.432229] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ffefa0-427d-4f30-afad-219c8791cb81 with Priority: HIGHEST for action port [ 688.432229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.432229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.432229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.432229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.433584] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.434754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.435256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.435597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ffefa0-427d-4f30-afad-219c8791cb81 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.435833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.435984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.436941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.437147] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ffefa0-427d-4f30-afad-219c8791cb81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.944657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.944657] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7ffefa0-427d-4f30-afad-219c8791cb81 with status ACTIVE [ 688.944657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.944657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.944657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.944657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.945493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.945493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.945493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.945493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.945493] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7ffefa0-427d-4f30-afad-219c8791cb81 is going to be updated. [ 688.981253] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.981467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.981467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.981898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.981898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.982205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ffefa0-427d-4f30-afad-219c8791cb81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.259100] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 690.259365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.259491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.259727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.259968] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.260102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.260563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.260563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.260563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.260563] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.763452] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.265930] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.772157] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.772448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.772532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.772942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.773171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.773375] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 691.805950] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.806072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.806072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.806298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.806526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.823025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 692.140227] env[69274]: INFO networking_nsxv3.common.synchronization [req-b5ab2f1e-ad9c-4468-887d-0bbd5a7fcb98 req-fa5aeb4e-c39e-4ef7-af56-7867225e7c21 tempest-ServerExternalEventsTest-1174317524 tempest-ServerExternalEventsTest-1174317524-project-member] Enqueued Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_members [ 692.141543] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee with Priority: HIGHEST for action security_group_members [ 692.141610] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.141788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.141850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.142052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.142213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.142315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.142377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.142945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.143059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.143160] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.149416] env[69274]: INFO networking_nsxv3.common.synchronization [req-c0c56363-dbbb-4a45-965e-addef6a4161d req-00018664-4896-47a7-82f9-6437af8f0949 tempest-FloatingIPsAssociationTestJSON-1878357021 tempest-FloatingIPsAssociationTestJSON-1878357021-project-member] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 692.149917] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 692.150228] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.150341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.150411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.150677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.150823] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.150922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.150985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.154301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.155158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.155158] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.648545] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.648887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.648929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.649521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.649763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.650120] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.650232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.650648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.650955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.651180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.651338] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee is going to be updated. [ 692.654456] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-62 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.654805] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.654869] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.655234] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.655662] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.655951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.656207] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.656639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.656862] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.657192] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.657351] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.657490] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.657647] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.657790] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.657921] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.658182] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.660415] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.713157] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.713364] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.055 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.713477] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.713659] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-62" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.714180] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-973cf1bf-7369-4fd7-a856-66cdec9bfadf taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.714180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.714303] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.715666] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.716969] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('973cf1bf-7369-4fd7-a856-66cdec9bfadf',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.723121] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.723265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.723337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.723546] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.723687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.736068] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee in Status: IN_PROGRESS for 2s [ 693.163158] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.219445] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.219662] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.219785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.220078] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.220234] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.220388] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 973cf1bf-7369-4fd7-a856-66cdec9bfadf not found, creating... [ 693.220751] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.221642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.221642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.221642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.221642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.221812] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.222826] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.222826] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.222969] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.223096] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.223241] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 973cf1bf-7369-4fd7-a856-66cdec9bfadf is going to be created. [ 693.267303] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.267303] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.267419] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.267661] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.267948] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.270748] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.472205] env[69274]: INFO networking_nsxv3.common.synchronization [req-92c36c30-4fd7-41d6-b25e-7e6d0edaa94d req-440e1c14-8459-4159-9b08-dded80603146 tempest-ImagesOneServerTestJSON-624855269 tempest-ImagesOneServerTestJSON-624855269-project-member] Enqueued Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_members [ 693.472664] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGHEST for action security_group_members [ 693.472966] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.473106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.473176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.473372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.473969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.473969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.473969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.473969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.473969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.474857] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.667362] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.667662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.668224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.668583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.668792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.669771] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be updated. [ 693.702428] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.702644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.702690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.702889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.703060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.714159] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: IN_PROGRESS for 2s [ 693.783045] env[69274]: INFO networking_nsxv3.common.synchronization [None req-ab980c1f-9041-43ed-adc7-16d312c03076 None None] Enqueued Resource ID: 37cb0272-c627-4efc-abf2-9276c66f0199 with Priority: HIGHEST for action port [ 693.783879] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37cb0272-c627-4efc-abf2-9276c66f0199 with Priority: HIGHEST for action port [ 693.784517] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-37cb0272-c627-4efc-abf2-9276c66f0199 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.785468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37cb0272-c627-4efc-abf2-9276c66f0199" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.785547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37cb0272-c627-4efc-abf2-9276c66f0199" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.785790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37cb0272-c627-4efc-abf2-9276c66f0199" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.785880] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37cb0272-c627-4efc-abf2-9276c66f0199',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.828816] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 693.829119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.829214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.829484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.829689] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.829799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.829880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.830162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.830162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.830347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.830347] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.948720] env[69274]: INFO networking_nsxv3.common.synchronization [req-c0c56363-dbbb-4a45-965e-addef6a4161d req-9a9026b8-ea3a-472b-9d39-c3d294538716 service nova] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_rules [ 693.948912] env[69274]: INFO networking_nsxv3.common.synchronization [req-c0c56363-dbbb-4a45-965e-addef6a4161d req-9a9026b8-ea3a-472b-9d39-c3d294538716 service nova] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 693.949078] env[69274]: INFO networking_nsxv3.common.synchronization [req-c0c56363-dbbb-4a45-965e-addef6a4161d req-9a9026b8-ea3a-472b-9d39-c3d294538716 service nova] Enqueued Resource ID: 973cf1bf-7369-4fd7-a856-66cdec9bfadf with Priority: HIGHEST for action port [ 693.949314] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_rules [ 693.949450] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 693.949614] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 973cf1bf-7369-4fd7-a856-66cdec9bfadf with Priority: HIGHEST for action port [ 693.950504] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.950734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.950900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.951175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.951291] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.955599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.955599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.955599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-973cf1bf-7369-4fd7-a856-66cdec9bfadf taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.955599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.955599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.955599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.955599] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('973cf1bf-7369-4fd7-a856-66cdec9bfadf',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.978403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.978578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.978651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.978859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.978946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.979140] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.979237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.979297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.979447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.979776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.979776] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb is going to be updated. [ 694.009169] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.009338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.009338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.010300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.010300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.019991] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb in Status: IN_PROGRESS for 2s [ 694.288779] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37cb0272-c627-4efc-abf2-9276c66f0199 [ 694.289189] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.289375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.289483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.289827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.289993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.290163] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37cb0272-c627-4efc-abf2-9276c66f0199 already deleted. [ 694.290317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37cb0272-c627-4efc-abf2-9276c66f0199" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.333048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.335775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.335775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.335775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.335775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.336390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.336390] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.455242] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.455397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.457804] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 973cf1bf-7369-4fd7-a856-66cdec9bfadf with status ACTIVE [ 694.458029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.458161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.458229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.458500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.458614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.460289] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.460415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.460829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.460829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.460829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.460977] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.461087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.461164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.461288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.461367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.461451] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 973cf1bf-7369-4fd7-a856-66cdec9bfadf is going to be updated. [ 694.493107] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.493264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.493433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.493590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.493699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.493868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-973cf1bf-7369-4fd7-a856-66cdec9bfadf" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.664886] env[69274]: INFO networking_nsxv3.common.synchronization [req-b5e7a18e-260b-44ee-8ea8-bbb671f2531b req-76123040-1d13-4b64-922a-0dbd6869ab3b tempest-DeleteServersAdminTestJSON-1417661457 tempest-DeleteServersAdminTestJSON-1417661457-project-member] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 694.664886] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 694.664886] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.664886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.664886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.665170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.665734] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.665886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.665957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.666175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.666283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.666391] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.747575] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee in Status: SUCCESS [ 694.748163] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee deletion is rescheduled due to dependency. [ 694.748372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.838572] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f: rpc.has_security_group_logging(os_id): False [ 694.856927] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.857101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.857172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.857389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.857485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.857679] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.857811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.857875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.858040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.859745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.859745] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.859745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.859745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.859745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.859745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.860057] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.860171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.860282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.861432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.861542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.861753] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 694.925320] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.925461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.925532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.925743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.925881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.942959] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 695.038891] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.039101] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.039226] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.039574] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.040936] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.041138] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.041259] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.041517] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.041677] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.041892] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.042013] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.042122] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.042229] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.042337] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.042442] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.042575] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.077700] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.077873] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.077990] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.078198] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.079038] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.079038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.079038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.079237] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.079277] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a99eb5e-e286-4882-8cc3-a2fe5058b5a2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.170581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.170788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.170853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.171046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.171142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.171338] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.171434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.171508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.171665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.171744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.171850] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be updated. [ 695.203791] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.203986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.203986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.204215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.204354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.214703] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: IN_PROGRESS for 2s [ 695.581886] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.582473] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.582769] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.585018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.585018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.585018] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 not found, creating... [ 695.585018] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.585018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.585018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.585018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.585018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.585018] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.585018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.585431] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.585935] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.587736] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.587736] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 is going to be created. [ 695.609477] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.609477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.609477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.609477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.609477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.609477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.726244] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: SUCCESS [ 695.726577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.726847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.727139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.730084] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.730230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.730305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.730534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.730611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.730715] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.032853] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb in Status: SUCCESS [ 696.033106] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb deletion is rescheduled due to dependency. [ 696.035985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163208] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3af15077-0805-4edf-b17c-064b4ca3677b None None] Enqueued Resource ID: f3d7b7b5-1fc2-4154-a518-acf4da9ceee1 with Priority: HIGHEST for action port [ 696.163560] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d7b7b5-1fc2-4154-a518-acf4da9ceee1 with Priority: HIGHEST for action port [ 696.164360] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3d7b7b5-1fc2-4154-a518-acf4da9ceee1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.164478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3d7b7b5-1fc2-4154-a518-acf4da9ceee1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.164694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3d7b7b5-1fc2-4154-a518-acf4da9ceee1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.164891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3d7b7b5-1fc2-4154-a518-acf4da9ceee1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.165795] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d7b7b5-1fc2-4154-a518-acf4da9ceee1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.234257] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.475182] env[69274]: INFO networking_nsxv3.common.synchronization [req-b5e7a18e-260b-44ee-8ea8-bbb671f2531b req-436ccbf4-40fd-4a1a-8c2c-f6003ea624a7 service nova] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_rules [ 696.475379] env[69274]: INFO networking_nsxv3.common.synchronization [req-b5e7a18e-260b-44ee-8ea8-bbb671f2531b req-436ccbf4-40fd-4a1a-8c2c-f6003ea624a7 service nova] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 696.475579] env[69274]: INFO networking_nsxv3.common.synchronization [req-b5e7a18e-260b-44ee-8ea8-bbb671f2531b req-436ccbf4-40fd-4a1a-8c2c-f6003ea624a7 service nova] Enqueued Resource ID: 3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 with Priority: HIGHEST for action port [ 696.475758] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_rules [ 696.475889] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 696.476053] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 with Priority: HIGHEST for action port [ 696.476600] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.476769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.476833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.481704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.481704] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.481704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.481704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.481704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.481704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.481704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.481704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.481704] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a99eb5e-e286-4882-8cc3-a2fe5058b5a2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.671310] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3d7b7b5-1fc2-4154-a518-acf4da9ceee1 [ 696.671310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.671310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.671310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.671310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.671310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.671744] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3d7b7b5-1fc2-4154-a518-acf4da9ceee1 already deleted. [ 696.672035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3d7b7b5-1fc2-4154-a518-acf4da9ceee1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.739386] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.848197] env[69274]: INFO networking_nsxv3.common.synchronization [None req-64e97039-8c9d-477d-8ef0-4734191d7c61 None None] Enqueued Resource ID: 547adfc6-84ef-4ea8-9b87-189bb8a6895d with Priority: HIGHEST for action port [ 696.848197] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 547adfc6-84ef-4ea8-9b87-189bb8a6895d with Priority: HIGHEST for action port [ 696.848981] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-547adfc6-84ef-4ea8-9b87-189bb8a6895d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.849093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-547adfc6-84ef-4ea8-9b87-189bb8a6895d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.849093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-547adfc6-84ef-4ea8-9b87-189bb8a6895d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.849341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-547adfc6-84ef-4ea8-9b87-189bb8a6895d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.849427] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('547adfc6-84ef-4ea8-9b87-189bb8a6895d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.960165] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 696.960416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.987429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.987600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.987788] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 with status ACTIVE [ 696.987940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.988064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.988132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.988354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.988531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.988721] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.991278] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.991278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.991278] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a99eb5e-e286-4882-8cc3-a2fe5058b5a2 is going to be updated. [ 697.015864] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.015864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.015864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.015864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.015864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.015864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a99eb5e-e286-4882-8cc3-a2fe5058b5a2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.225188] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: SUCCESS [ 697.225522] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 deletion is rescheduled due to dependency. [ 697.225522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.225671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.225911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.226124] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.226256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.226320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.226498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.226582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.226702] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.243513] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.243513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.243513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.243513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.243513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.243513] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be updated. [ 697.283355] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.283355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.283355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.283355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.283355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.295302] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: IN_PROGRESS for 2s [ 697.357522] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 547adfc6-84ef-4ea8-9b87-189bb8a6895d [ 697.357789] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.357927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.358048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.358245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.358350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.358445] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:547adfc6-84ef-4ea8-9b87-189bb8a6895d already deleted. [ 697.358540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-547adfc6-84ef-4ea8-9b87-189bb8a6895d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.730616] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.234995] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.738037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.738578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.738675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.739939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.740073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.740186] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be updated. [ 698.781229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.781419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.781541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.781893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.783829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.795290] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: IN_PROGRESS for 2s [ 699.304963] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: SUCCESS [ 699.305267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.305429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.305609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.305800] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.305916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.305982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.306142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.306234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.306322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.306414] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.578135] env[69274]: INFO networking_nsxv3.common.synchronization [None req-9117edae-e4fd-4a6b-884c-e0439bb7fa92 None None] Enqueued Resource ID: bfcb79c0-43b1-4652-94ae-1bbe3646e393 with Priority: HIGHEST for action port [ 699.578418] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfcb79c0-43b1-4652-94ae-1bbe3646e393 with Priority: HIGHEST for action port [ 699.580681] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfcb79c0-43b1-4652-94ae-1bbe3646e393 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.581135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfcb79c0-43b1-4652-94ae-1bbe3646e393" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.581319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfcb79c0-43b1-4652-94ae-1bbe3646e393" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.581675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfcb79c0-43b1-4652-94ae-1bbe3646e393" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.582070] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfcb79c0-43b1-4652-94ae-1bbe3646e393',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.809521] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.809907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.810018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.810220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.810408] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.810509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.810628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.810781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.810891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.811042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.811242] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.811439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.811439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.811517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.811648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.811736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.811790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.811920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.811998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.812570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.812894] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.088064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfcb79c0-43b1-4652-94ae-1bbe3646e393 [ 700.088064] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.088064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.088064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.088064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.088064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.088064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfcb79c0-43b1-4652-94ae-1bbe3646e393 already deleted. [ 700.088064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfcb79c0-43b1-4652-94ae-1bbe3646e393" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.315404] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55f154d6-8c77-4554-a90c-034e9602b91b: rpc.has_security_group_logging(os_id): False [ 700.335432] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.335585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.335656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.335904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.335999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.336200] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.336295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.336357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.336507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.336588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.336814] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.336913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.336974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.337127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.337202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.337381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.337471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.337531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.337664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.337739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.337822] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be updated. [ 700.401240] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.405026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.405026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.405026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.405026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.417386] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: IN_PROGRESS for 2s [ 700.806170] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: SUCCESS [ 700.806470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.806678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.806904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.807106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.807283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.807283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.807535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.807535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.807662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.807902] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.311388] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.311543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.311609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.311880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.312064] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.312169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.312231] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.312384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.312468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.312553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.312725] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.312772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.312831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.312965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.313108] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.313195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.313252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.313388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.313459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.313535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.313633] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.356518] env[69274]: INFO networking_nsxv3.common.synchronization [req-7c7ebe79-2269-439f-b020-e551f287ce21 req-d60996ed-b377-4842-838e-106ed210756b tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 701.357140] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 701.357385] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.357635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.357635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.357838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.358012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.358118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.358193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.358347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.358455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.358581] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.739110] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.739110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.739110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.739110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.739427] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.739622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.739746] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.739971] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.740133] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.740494] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.740494] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.740685] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.740786] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.740903] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.741021] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.741158] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.762318] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.762500] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.762637] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.762812] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.763143] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-12bab44a-ec1c-48e6-8990-d8e93b81d17c taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.763314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.763431] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.763878] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.764021] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12bab44a-ec1c-48e6-8990-d8e93b81d17c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.818102] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2840b5fb-3a8f-4d93-a381-953dc8e31a67: rpc.has_security_group_logging(os_id): False [ 701.837729] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.837924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.838057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.838300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.838439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.838704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.838815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.838873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.839055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.839138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.839388] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.839482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.839573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.839967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.839967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.840136] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.840237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.840295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.840433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.841026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.841026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be updated. [ 701.860774] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.860967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.861070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.861348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.861405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.861685] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.861872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.861872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.862156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.862156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.862285] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 already deleted. [ 701.862285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.904523] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.904666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.904783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.905094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.905270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.917273] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: IN_PROGRESS for 2s [ 702.269626] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.269626] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 12bab44a-ec1c-48e6-8990-d8e93b81d17c not found, creating... [ 702.269626] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.269626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.270167] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.270167] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.271030] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.271449] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.271738] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.272053] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c is going to be created. [ 702.299582] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.301243] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.301243] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.301243] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.301243] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.304513] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.437400] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: SUCCESS [ 702.437726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.169644] env[69274]: INFO networking_nsxv3.common.synchronization [req-7c7ebe79-2269-439f-b020-e551f287ce21 req-adf97c02-3637-45b8-a86c-81ca644f38ba service nova] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 703.169947] env[69274]: INFO networking_nsxv3.common.synchronization [req-7c7ebe79-2269-439f-b020-e551f287ce21 req-adf97c02-3637-45b8-a86c-81ca644f38ba service nova] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 703.173676] env[69274]: INFO networking_nsxv3.common.synchronization [req-7c7ebe79-2269-439f-b020-e551f287ce21 req-adf97c02-3637-45b8-a86c-81ca644f38ba service nova] Enqueued Resource ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c with Priority: HIGHEST for action port [ 703.174368] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 703.174520] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 703.174635] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c with Priority: HIGHEST for action port [ 703.174935] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.175077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.175147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.175441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.175951] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.177134] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.177241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.177241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.177431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.177586] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.177674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.177740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.177883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.178214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.178214] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.178908] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-12bab44a-ec1c-48e6-8990-d8e93b81d17c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.179012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.179332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.179332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.179561] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12bab44a-ec1c-48e6-8990-d8e93b81d17c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.683758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.683758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.683758] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.683758] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12bab44a-ec1c-48e6-8990-d8e93b81d17c with status ACTIVE [ 703.683758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.683758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.683758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.683758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.684487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.684487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.684487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.684487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.684487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.684487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.684663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.684663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.684744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.684855] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.684925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.685036] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c is going to be updated. [ 703.710374] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.710742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.710742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.711487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.711487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.711487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.935117] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: SUCCESS [ 703.935117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.187071] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.690988] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.691316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.691316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.691447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.691538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.691728] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be created. [ 704.720161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.720302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.720368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.720651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.720826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.731418] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: UNINITIALIZED for 2s [ 704.951907] env[69274]: INFO networking_nsxv3.common.synchronization [req-51a2c464-a878-47be-bc29-b41d8ecb456f req-87631c92-1b94-41ff-8206-7d1867e0b9a1 tempest-ServerDiagnosticsTest-2142082643 tempest-ServerDiagnosticsTest-2142082643-project-member] Enqueued Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_members [ 704.952520] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_members [ 704.952835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.952963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.953200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.953471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.953630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.953738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.953804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.953958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.954059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.954155] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.457981] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.458155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.458226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.458445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.458561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.458771] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.458875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.458938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.459117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.459197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.459281] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6398991b-d5ff-4f53-a138-3545155245b1 already deleted. [ 705.459362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.497340] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.500261] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.500524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.500842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.501222] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.501410] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.501651] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.501878] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.502109] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.502406] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.502566] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.502713] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.502846] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.503038] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.503202] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.503441] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.525932] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.526239] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.530032] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.530032] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.530032] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-962c2066-01b9-4ce6-9253-2a68a5352459 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.530032] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.530032] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.530032] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.530032] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962c2066-01b9-4ce6-9253-2a68a5352459',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.031104] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.031558] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.031558] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.031848] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.032052] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.032240] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 962c2066-01b9-4ce6-9253-2a68a5352459 not found, creating... [ 706.032534] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.032756] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.032876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.033135] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.033285] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.033604] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.033778] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.033908] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.034158] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.034323] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.034477] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 962c2066-01b9-4ce6-9253-2a68a5352459 is going to be created. [ 706.058855] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.059138] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.059276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.059674] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.059922] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.060343] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.741536] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 706.741896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.742137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.742368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.742569] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.742688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.742757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.742913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.742999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.743098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.743191] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.855366] env[69274]: INFO networking_nsxv3.common.synchronization [req-51a2c464-a878-47be-bc29-b41d8ecb456f req-ec6b3853-026e-4b48-b85d-3a290d1f859a service nova] Enqueued Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_rules [ 706.855552] env[69274]: INFO networking_nsxv3.common.synchronization [req-51a2c464-a878-47be-bc29-b41d8ecb456f req-ec6b3853-026e-4b48-b85d-3a290d1f859a service nova] Enqueued Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_members [ 706.855693] env[69274]: INFO networking_nsxv3.common.synchronization [req-51a2c464-a878-47be-bc29-b41d8ecb456f req-ec6b3853-026e-4b48-b85d-3a290d1f859a service nova] Enqueued Resource ID: 962c2066-01b9-4ce6-9253-2a68a5352459 with Priority: HIGHEST for action port [ 706.856027] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_rules [ 706.856204] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_members [ 706.856307] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 962c2066-01b9-4ce6-9253-2a68a5352459 with Priority: HIGHEST for action port [ 706.856891] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.857359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.857475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.857725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.857814] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.858655] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.858766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.858840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.859054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.859154] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.859249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.859310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.859746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.863020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.863020] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.863020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-962c2066-01b9-4ce6-9253-2a68a5352459 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.863020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.863020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.863020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.863020] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962c2066-01b9-4ce6-9253-2a68a5352459',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.246057] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.246057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.246057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.246877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.246877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.246877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.246877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.246877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.246877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.247673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.247673] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.247673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.247673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.247673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.247673] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.248037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.248037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.248037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.248037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.248248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.248248] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.363029] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.364212] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.364338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.364479] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 962c2066-01b9-4ce6-9253-2a68a5352459 with status ACTIVE [ 707.364637] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.365073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.365073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.365073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.365194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.365332] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.365595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.365595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.365692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.365730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.365921] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.368882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.369204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.369469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.369631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.370100] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 962c2066-01b9-4ce6-9253-2a68a5352459 is going to be updated. [ 707.398790] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.399581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.399581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.399581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.399581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.399581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-962c2066-01b9-4ce6-9253-2a68a5352459" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.756191] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0551ddf-e014-4e0b-b17c-9e30f1dac015: rpc.has_security_group_logging(os_id): False [ 707.774154] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.774492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.774973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.775681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.775681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.776058] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.776730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.776730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.776730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.776730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.777094] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.777291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.777532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.777752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.777909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.778201] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.778417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.778663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.778924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.779078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.779220] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be created. [ 707.847999] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.847999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.847999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.847999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.847999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.860691] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 707.872214] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.380062] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.380062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.380062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.380062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.380540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.380540] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6398991b-d5ff-4f53-a138-3545155245b1 is going to be created. [ 708.407371] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.407535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.407573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.407785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.407943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.418112] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6398991b-d5ff-4f53-a138-3545155245b1 in Status: UNINITIALIZED for 2s [ 709.647187] env[69274]: INFO networking_nsxv3.common.synchronization [req-9dfb1772-c42d-4dd8-8e89-3185cf8bd8db req-970a02d5-4430-4787-a6da-fa454ef709aa tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 709.651399] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 709.651793] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.651929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.652036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.652784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.652784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.652784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.652784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.653048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.653048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.653048] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.688727] env[69274]: INFO networking_nsxv3.common.synchronization [req-61d72974-858e-4910-ac08-d6c2e94b2f90 req-3a7bb1a9-79dc-48b1-bb5f-5e1773bdd777 tempest-DeleteServersAdminTestJSON-1417661457 tempest-DeleteServersAdminTestJSON-1417661457-project-member] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 709.695762] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGHEST for action security_group_members [ 709.695762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.695762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.695762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.695762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.695762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.695762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.695762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.695762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.695762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.695762] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.874404] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 709.874622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.069894] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.070056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.070056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.070399] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.070720] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.070903] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.071024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.071295] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.071397] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.071653] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.071723] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.071842] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.071953] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.072080] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.072188] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.072322] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.091955] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.092084] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 710.092204] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.092389] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.092715] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.092891] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.093054] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.093407] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.093541] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a3eaaf-5bd3-43bb-814b-562f22e9a962',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.155599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.155761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.155837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.156069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.156164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.156354] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.156456] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.156517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.156666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.156746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.156832] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 already deleted. [ 710.156914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.202797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.202797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.202797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.202797] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be updated. [ 710.237013] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.237262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.237325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.237655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.237862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.250994] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: IN_PROGRESS for 2s [ 710.430245] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6398991b-d5ff-4f53-a138-3545155245b1 in Status: SUCCESS [ 710.430969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.430969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.431153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.431264] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.431412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.431481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.432083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.432083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.432083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.432083] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.596411] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.598430] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.598430] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.600025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.600317] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.600548] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port f0a3eaaf-5bd3-43bb-814b-562f22e9a962 not found, creating... [ 710.600998] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.601255] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.601777] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.601777] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.601940] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.602321] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.602491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.602621] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.602889] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.603100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.603283] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: f0a3eaaf-5bd3-43bb-814b-562f22e9a962 is going to be created. [ 710.627025] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.627025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.627025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.627025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.627025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.627025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.938739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.938739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.938739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.938739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.938739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.939496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.939496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.939496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.939496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.939496] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.442974] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6398991b-d5ff-4f53-a138-3545155245b1: rpc.has_security_group_logging(os_id): False [ 711.479176] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.479176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.479176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.479176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.479176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.479176] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.479176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.479980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.479980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.479980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.479980] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.479980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.479980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.485091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.485091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.485091] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.485091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.485091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.485427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.485427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.485427] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6398991b-d5ff-4f53-a138-3545155245b1 is going to be created. [ 711.549228] env[69274]: INFO networking_nsxv3.common.synchronization [req-9dfb1772-c42d-4dd8-8e89-3185cf8bd8db req-a08e40bb-d5f1-4528-b17e-727fc0e3df8d service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 711.549228] env[69274]: INFO networking_nsxv3.common.synchronization [req-9dfb1772-c42d-4dd8-8e89-3185cf8bd8db req-a08e40bb-d5f1-4528-b17e-727fc0e3df8d service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 711.549228] env[69274]: INFO networking_nsxv3.common.synchronization [req-9dfb1772-c42d-4dd8-8e89-3185cf8bd8db req-a08e40bb-d5f1-4528-b17e-727fc0e3df8d service nova] Enqueued Resource ID: f0a3eaaf-5bd3-43bb-814b-562f22e9a962 with Priority: HIGHEST for action port [ 711.549228] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 711.549228] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 711.549858] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0a3eaaf-5bd3-43bb-814b-562f22e9a962 with Priority: HIGHEST for action port [ 711.551762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.551902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.551972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.552256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.552332] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.556354] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.556510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.556569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.556788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.557072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.557072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.557156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.557290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.557379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.557475] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.558846] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.558967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.559038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.559207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.559283] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a3eaaf-5bd3-43bb-814b-562f22e9a962',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.565239] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.565367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.565510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.565771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.565967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.584753] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6398991b-d5ff-4f53-a138-3545155245b1 in Status: IN_PROGRESS for 2s [ 712.055338] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.055338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.063204] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.066919] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0a3eaaf-5bd3-43bb-814b-562f22e9a962 with status ACTIVE [ 712.067163] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.067391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.067391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.067602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.067709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.067892] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.067998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.068086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.068259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.068346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.068634] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.068738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.068776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.069062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.073520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.073710] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0a3eaaf-5bd3-43bb-814b-562f22e9a962 is going to be updated. [ 712.100139] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.100309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.100384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.100611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.100782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.100960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0a3eaaf-5bd3-43bb-814b-562f22e9a962" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.258781] env[69274]: INFO networking_nsxv3.common.synchronization [req-d96b9496-7d64-4a71-a89b-0bd80f764b4b req-ebd1b085-45b3-461f-8c4f-93eea71fc700 tempest-ServerActionsV293TestJSON-1995669322 tempest-ServerActionsV293TestJSON-1995669322-project-member] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_members [ 712.258781] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_members [ 712.258781] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.258781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.258781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.259125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.260036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.260209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.260331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.260556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.260717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.260875] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.264822] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 in Status: SUCCESS [ 712.264966] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 deletion is rescheduled due to dependency. [ 712.265406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.566061] env[69274]: INFO networking_nsxv3.common.synchronization [req-88eb8e5a-63f2-4864-8923-2a69458b1e16 req-092b1fc9-238e-4a91-92c4-ea491be7c898 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 712.566275] env[69274]: INFO networking_nsxv3.common.synchronization [req-88eb8e5a-63f2-4864-8923-2a69458b1e16 req-092b1fc9-238e-4a91-92c4-ea491be7c898 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 712.566829] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 712.566986] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 712.567281] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.567496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.567496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.567773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.567861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.567974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.570157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.570361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.570472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.570601] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.573684] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.573684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.573684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.573684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.573684] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.573684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.573684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.573684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.573684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.573684] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.575439] env[69274]: INFO networking_nsxv3.common.synchronization [req-70a50f31-8a26-4877-a1ee-01544dec7139 req-272f0865-05d9-452a-ad8f-a49d020f8fa9 tempest-FloatingIPsAssociationTestJSON-1878357021 tempest-FloatingIPsAssociationTestJSON-1878357021-project-member] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 712.576052] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.576628] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 712.577328] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.577462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.577531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.577712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.577864] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.577977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.578103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.578240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.578454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.578579] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.698824] env[69274]: INFO networking_nsxv3.common.synchronization [req-88eb8e5a-63f2-4864-8923-2a69458b1e16 req-092b1fc9-238e-4a91-92c4-ea491be7c898 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_rules [ 712.699108] env[69274]: INFO networking_nsxv3.common.synchronization [req-88eb8e5a-63f2-4864-8923-2a69458b1e16 req-092b1fc9-238e-4a91-92c4-ea491be7c898 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 712.699205] env[69274]: INFO networking_nsxv3.common.synchronization [req-88eb8e5a-63f2-4864-8923-2a69458b1e16 req-092b1fc9-238e-4a91-92c4-ea491be7c898 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 712.699395] env[69274]: INFO networking_nsxv3.common.synchronization [req-88eb8e5a-63f2-4864-8923-2a69458b1e16 req-092b1fc9-238e-4a91-92c4-ea491be7c898 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 712.699546] env[69274]: INFO networking_nsxv3.common.synchronization [req-88eb8e5a-63f2-4864-8923-2a69458b1e16 req-092b1fc9-238e-4a91-92c4-ea491be7c898 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c with Priority: HIGHEST for action port [ 712.700164] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_rules [ 712.700305] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 712.700420] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c with Priority: HIGHEST for action port [ 712.700498] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 712.701070] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 712.701461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.701664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.701787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.702187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.702340] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.703615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.707223] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.707223] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-12bab44a-ec1c-48e6-8990-d8e93b81d17c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.707223] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12bab44a-ec1c-48e6-8990-d8e93b81d17c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.707223] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.707223] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.707223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.768327] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.768327] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.768327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.768777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a already deleted. [ 712.768777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.040314] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-611 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.040578] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-611" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.040774] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-611" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.050021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-611" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.050021] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.050021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.050021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.050021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.050021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.050021] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.050021] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.050021] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.050021] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.050021] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.050021] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.050591] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.075145] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.079667] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.081039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.081039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.081039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.081309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.081397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.081518] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be created. [ 713.086811] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.095527] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.095527] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.095603] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.095871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-611" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.096357] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-1d498bf3-4624-4790-9ac8-88656efc07d8 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.096649] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.096825] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.097556] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.097651] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d498bf3-4624-4790-9ac8-88656efc07d8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.119032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.119032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.119032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.119032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.119032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.129672] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: UNINITIALIZED for 2s [ 713.208074] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.208225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.208501] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.208613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.208848] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12bab44a-ec1c-48e6-8990-d8e93b81d17c with status ACTIVE [ 713.209020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.209131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.209198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.209415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.209511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.209688] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.209780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.209847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.210011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.210100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.210284] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.210381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.210564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.210564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.210738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.210899] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c is going to be updated. [ 713.257033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.257033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.257033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.257033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.257033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.257033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.583137] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.586824] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.589402] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.598848] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6398991b-d5ff-4f53-a138-3545155245b1 in Status: SUCCESS [ 713.599118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.599706] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.599940] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.600088] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.600610] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.600610] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.601023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 1d498bf3-4624-4790-9ac8-88656efc07d8 not found, creating... [ 713.601117] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.601297] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.601420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.601670] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.602236] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.602236] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.602477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.602477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.602886] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.603068] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.603118] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 1d498bf3-4624-4790-9ac8-88656efc07d8 is going to be created. [ 713.628705] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.628958] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.629425] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.629691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.629918] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.630167] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.950165] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_members [ 713.950165] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 713.950165] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 713.950819] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_members [ 713.951043] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 713.951135] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 713.951392] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.951600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.951600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.952445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.952445] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.952445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.952445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.952445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.952445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.952837] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.953557] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.953633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.953754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.953828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.007628] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_rules [ 714.007628] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_members [ 714.007628] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_rules [ 714.007628] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 714.009060] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 714.009507] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 714.009936] env[69274]: INFO networking_nsxv3.common.synchronization [req-c249f7b2-051f-466c-9e89-0c8db148be19 req-acd40c66-28da-4994-9752-847ede865219 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c with Priority: HIGHEST for action port [ 714.010829] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_rules [ 714.011114] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_rules [ 714.011359] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 714.011567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c with Priority: HIGHEST for action port [ 714.011776] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 714.011995] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_members [ 714.012227] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 714.012618] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.013467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.013569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.013878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.014144] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.015247] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.015409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.016414] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.016414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.016414] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-12bab44a-ec1c-48e6-8990-d8e93b81d17c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.016414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.016414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.016648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.016897] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12bab44a-ec1c-48e6-8990-d8e93b81d17c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.017753] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.017896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.018097] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.018208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.018415] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.018538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.084221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.084560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.084560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.084880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.085047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.085196] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 714.092044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.092044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.092044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.092314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.092314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.092314] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be created. [ 714.093560] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.093684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.093761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.093929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.094027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.094129] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be updated. [ 714.125037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.125215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.125215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.125430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.125610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.132179] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.132348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.132397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.132587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.132715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.140408] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: UNINITIALIZED for 2s [ 714.141232] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 714.151876] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.151876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.151876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.151876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.151876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.161078] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: IN_PROGRESS for 2s [ 714.456410] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.507114] env[69274]: INFO networking_nsxv3.common.synchronization [req-d96b9496-7d64-4a71-a89b-0bd80f764b4b req-f7c3cefd-0792-4b3b-8dde-d9264f28c7ae service nova] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_rules [ 714.507114] env[69274]: INFO networking_nsxv3.common.synchronization [req-d96b9496-7d64-4a71-a89b-0bd80f764b4b req-f7c3cefd-0792-4b3b-8dde-d9264f28c7ae service nova] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_members [ 714.507114] env[69274]: INFO networking_nsxv3.common.synchronization [req-d96b9496-7d64-4a71-a89b-0bd80f764b4b req-f7c3cefd-0792-4b3b-8dde-d9264f28c7ae service nova] Enqueued Resource ID: 1d498bf3-4624-4790-9ac8-88656efc07d8 with Priority: HIGHEST for action port [ 714.507342] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_rules [ 714.507424] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_members [ 714.507563] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d498bf3-4624-4790-9ac8-88656efc07d8 with Priority: HIGHEST for action port [ 714.507752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.507868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.507930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.509807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.509955] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.510893] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.511067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.511181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.511371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.511548] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.512133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.512246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.512437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.512565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.512686] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.513911] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d498bf3-4624-4790-9ac8-88656efc07d8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.514126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.514504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.514720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.514855] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d498bf3-4624-4790-9ac8-88656efc07d8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.520193] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.520193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.520335] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12bab44a-ec1c-48e6-8990-d8e93b81d17c with status ACTIVE [ 714.520408] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.520484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.520673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.520833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.520931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.521121] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.521220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.521282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.521430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.521497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.521845] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.521845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.521972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.522037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.522126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.522175] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12bab44a-ec1c-48e6-8990-d8e93b81d17c is going to be updated. [ 714.545841] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.546505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.546505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.546505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.546505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.546722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12bab44a-ec1c-48e6-8990-d8e93b81d17c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.958683] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.018371] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.018551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.018718] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.019726] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d498bf3-4624-4790-9ac8-88656efc07d8 with status ACTIVE [ 715.019969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.020110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.020172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.020381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.020467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.020635] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.020765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.020888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.020988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.021206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.021396] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.021496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.021562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.021732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.021831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.021886] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d498bf3-4624-4790-9ac8-88656efc07d8 is going to be updated. [ 715.044842] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.044941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.045056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.045318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.045447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.045614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d498bf3-4624-4790-9ac8-88656efc07d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.147968] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 715.149862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.149862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.150070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.150623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.150623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.150623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.150623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.150859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.150859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.150924] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.462846] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.462846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.462846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.462846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.462846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.462846] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e is going to be created. [ 715.486310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.486467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.486539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.486756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.487391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.497740] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: UNINITIALIZED for 2s [ 715.526164] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.656570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.656570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.656570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.656570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.656570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.657190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.657190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.657190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.657190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.657190] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.029431] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.029431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.029431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.029661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.029754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.030027] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a is going to be created. [ 716.059098] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.059246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.059314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.059528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.059695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.073593] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: UNINITIALIZED for 2s [ 716.157691] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 716.158147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.158724] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 716.158879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.159052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.159276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.159455] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.159572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.159636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.159796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.159881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.159975] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.161045] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 716.162056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.162272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.162436] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.162542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.162607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.162754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.162833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.162921] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.171160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: IN_PROGRESS for 4s [ 716.180920] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.181078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.181143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.181390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.181432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.181637] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.181758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.181834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.181959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.182050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.182226] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.182321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.182383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.182524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.182598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.182944] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.183061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.183183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.183338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.183474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.183586] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be created. [ 716.274047] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.274255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.274296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.274495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.274679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.294158] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 716.670912] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.677168] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.726487] env[69274]: INFO networking_nsxv3.common.synchronization [req-1eb190cc-0d11-4670-9952-824127cf0c7f req-e57a713b-9392-4618-8104-28966048b1d6 tempest-FloatingIPsAssociationNegativeTestJSON-526268844 tempest-FloatingIPsAssociationNegativeTestJSON-526268844-project-member] Enqueued Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_members [ 716.726487] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_members [ 716.726487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.727965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.727965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.727965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.728136] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.728288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.728376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.728625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.728759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.728891] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.181552] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.181552] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.231870] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.232483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.234086] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.234086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1440c9a-5782-4214-aa24-1446e4f91d71 already deleted. [ 717.234086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.399656] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.399804] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-59" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.399862] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-59" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.400193] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-59" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.400463] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.400621] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.400803] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.401095] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.402562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.402562] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.402562] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.402562] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.402562] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.402562] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.402562] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.402562] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.424039] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.424307] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.425300] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.425513] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-59" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.425881] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.426122] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.426530] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.426994] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.427197] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53782dc2-2cb1-47f6-b8aa-7d12b433ebaa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.513814] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: SUCCESS [ 717.513814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.513814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.514087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.514381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.514381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.514517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.514751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.514824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.514913] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.682389] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.682568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.682706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.683028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.683028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.683163] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be updated. [ 717.689148] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.689299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.689370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.689604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.689697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.689794] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 717.741098] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.741327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.741464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.741821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.742028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.748297] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.748451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.748521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.748784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.748908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.761046] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 717.764767] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: IN_PROGRESS for 2s [ 717.929970] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.930254] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.930350] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.930648] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.930852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.931039] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 53782dc2-2cb1-47f6-b8aa-7d12b433ebaa not found, creating... [ 717.931314] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.931476] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.931597] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.931866] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.932106] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.932377] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.932536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.932657] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.932883] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.933479] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.933901] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 53782dc2-2cb1-47f6-b8aa-7d12b433ebaa is going to be created. [ 717.969841] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.969841] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.970046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.970494] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.970867] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.971157] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.017677] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.088367] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: SUCCESS [ 718.088367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.088367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.088367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.088770] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.088770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.088980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.089095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.089288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.089288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.089372] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.187111] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: SUCCESS [ 718.187495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.312995] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 718.312995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.520826] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.593010] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.022336] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.022523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.022600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.022867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.022965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.023116] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e is going to be updated. [ 719.064533] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.064533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.064533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.064878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.064927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.081566] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: IN_PROGRESS for 2s [ 719.084938] env[69274]: INFO networking_nsxv3.common.synchronization [req-1eb190cc-0d11-4670-9952-824127cf0c7f req-bd02bea2-e27f-4b40-9b1d-679a80aea677 service nova] Enqueued Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_rules [ 719.085134] env[69274]: INFO networking_nsxv3.common.synchronization [req-1eb190cc-0d11-4670-9952-824127cf0c7f req-bd02bea2-e27f-4b40-9b1d-679a80aea677 service nova] Enqueued Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_members [ 719.085330] env[69274]: INFO networking_nsxv3.common.synchronization [req-1eb190cc-0d11-4670-9952-824127cf0c7f req-bd02bea2-e27f-4b40-9b1d-679a80aea677 service nova] Enqueued Resource ID: 53782dc2-2cb1-47f6-b8aa-7d12b433ebaa with Priority: HIGHEST for action port [ 719.086104] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_rules [ 719.086278] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_members [ 719.086431] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53782dc2-2cb1-47f6-b8aa-7d12b433ebaa with Priority: HIGHEST for action port [ 719.086833] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.087234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.087234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.087399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.087505] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.090636] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.090636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.090636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.090636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.090636] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.090636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.090636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.090636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.090636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.091066] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.091615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.091730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.091839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.093072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.093364] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53782dc2-2cb1-47f6-b8aa-7d12b433ebaa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.095945] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c76c584-6c00-46aa-955a-014f7c87551a: rpc.has_security_group_logging(os_id): False [ 719.121160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.121160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.121160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.121160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a is going to be created. [ 719.251656] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.252132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.252132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.252132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.252311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.270227] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: IN_PROGRESS for 2s [ 719.590529] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.590961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.595468] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.597499] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53782dc2-2cb1-47f6-b8aa-7d12b433ebaa with status ACTIVE [ 719.598990] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.598990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.598990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.598990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.598990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.598990] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.598990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.598990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.599607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.599607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.600170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.600331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.600411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.600619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.600809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.605359] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53782dc2-2cb1-47f6-b8aa-7d12b433ebaa is going to be updated. [ 719.634140] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.634140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.634140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.634140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.634473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.634473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53782dc2-2cb1-47f6-b8aa-7d12b433ebaa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.749091] env[69274]: INFO networking_nsxv3.common.synchronization [None req-9f63afa4-b18a-4376-80c6-5ac65a5845bb None None] Enqueued Resource ID: 9d24d9fc-ddd0-4262-850b-e35867db1469 with Priority: HIGHEST for action port [ 719.749723] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d24d9fc-ddd0-4262-850b-e35867db1469 with Priority: HIGHEST for action port [ 719.750060] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d24d9fc-ddd0-4262-850b-e35867db1469 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.750199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d24d9fc-ddd0-4262-850b-e35867db1469" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.750271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d24d9fc-ddd0-4262-850b-e35867db1469" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.753061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d24d9fc-ddd0-4262-850b-e35867db1469" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.753061] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d24d9fc-ddd0-4262-850b-e35867db1469',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.784760] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.784760] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.784760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.784760] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.787264] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 719.787733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.788464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.792754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.792754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.792754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.792754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.792754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.792754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.792754] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.796042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.796042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.796042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.796042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.796042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.796042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.796042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.796042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.796042] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.796970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.797327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.797566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.797689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.797967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.798160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.798251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.798364] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.107301] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.254213] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d24d9fc-ddd0-4262-850b-e35867db1469 [ 720.254213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.254213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.254213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.254213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.254213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.254213] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d24d9fc-ddd0-4262-850b-e35867db1469 already deleted. [ 720.254213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d24d9fc-ddd0-4262-850b-e35867db1469" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.298731] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.298731] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.298731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.301057] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.303800] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.609417] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.609582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.609753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.609958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.610072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.610211] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1440c9a-5782-4214-aa24-1446e4f91d71 is going to be created. [ 720.647166] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.647543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.647543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.647543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.647732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.662346] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1440c9a-5782-4214-aa24-1446e4f91d71 in Status: UNINITIALIZED for 2s [ 720.754198] env[69274]: INFO networking_nsxv3.common.synchronization [req-71261df7-412a-4f7b-8dcd-247fcf6b6067 req-931487d3-7cd7-4d44-ab37-04ee96509218 tempest-ServerDiagnosticsTest-2142082643 tempest-ServerDiagnosticsTest-2142082643-project-member] Enqueued Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_members [ 720.754821] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGHEST for action security_group_members [ 720.755094] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.755239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.755308] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.755516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.755725] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.755795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.755827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.755969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.756070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.756165] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.800344] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.810216] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.811362] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cebac9fe-4ea0-40a1-a949-d690687274d0: rpc.has_security_group_logging(os_id): False [ 720.835206] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.835206] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.835206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.835206] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be created. [ 720.904697] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.904697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.904697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.904697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.904697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.918680] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: IN_PROGRESS for 2s [ 721.100155] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: SUCCESS [ 721.100155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.100155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.100155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.100155] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.100655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.100655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.100655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.100655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.100655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.100655] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.261106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.261106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.261106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.261106] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6398991b-d5ff-4f53-a138-3545155245b1 is going to be updated. [ 721.295294] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: SUCCESS [ 721.295294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.298805] env[69274]: INFO networking_nsxv3.common.synchronization [None req-5058ea96-8c97-4400-8fe7-85b1afbd8905 tempest-ServersTestJSON-1296568971 tempest-ServersTestJSON-1296568971-project-member] Enqueued Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_rules [ 721.299485] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_rules [ 721.299952] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.300075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.301196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.305024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.305024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.305024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.305024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.305024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.305024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.305583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.305868] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 721.309348] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.309521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.309589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.309799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.309934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.314801] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.315064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.315172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.315385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.315476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.315628] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be updated. [ 721.322673] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6398991b-d5ff-4f53-a138-3545155245b1 in Status: IN_PROGRESS for 2s [ 721.356709] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.356909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.356909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.357155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.357307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.359928] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.360106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.360168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.360354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.360508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.372086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: IN_PROGRESS for 2s [ 721.373125] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 721.481529] env[69274]: INFO networking_nsxv3.common.synchronization [None req-8981127f-8e1d-40e5-b581-e6ddde1292b7 tempest-ServersTestJSON-1296568971 tempest-ServersTestJSON-1296568971-project-member] Enqueued Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_rules [ 721.482671] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_rules [ 721.482671] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.482671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.603134] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.832547] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.832547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.832547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.832547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.832547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.832547] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 already deleted. [ 721.832547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.832547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.832547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.832547] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.104951] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 006dff36-9ba4-4e78-adb7-43e0f38d6a3e: rpc.has_security_group_logging(os_id): False [ 722.136300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.136462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.136522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.136937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.136937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.137083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.137367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.137367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.137574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.137574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.137666] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e is going to be created. [ 722.224159] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.224159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.224159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.224159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.224159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.248361] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: IN_PROGRESS for 2s [ 722.357044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.357044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.357044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.357044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.357044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.357044] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 already deleted. [ 722.357044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.679179] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1440c9a-5782-4214-aa24-1446e4f91d71 in Status: SUCCESS [ 722.679672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.679772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.683869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.684380] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.684648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.684781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.685229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.685346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.685488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.685630] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.936115] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 722.936287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.936440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.940042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.940240] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.983144] env[69274]: INFO networking_nsxv3.common.synchronization [None req-12a5e05c-b74d-47de-8b96-3ec5e03daa6f None None] Enqueued Resource ID: 7482019c-8c3d-47c6-8d6b-0bc1c100d27f with Priority: HIGHEST for action port [ 722.983604] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7482019c-8c3d-47c6-8d6b-0bc1c100d27f with Priority: HIGHEST for action port [ 722.983989] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-7482019c-8c3d-47c6-8d6b-0bc1c100d27f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.984448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7482019c-8c3d-47c6-8d6b-0bc1c100d27f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.984448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7482019c-8c3d-47c6-8d6b-0bc1c100d27f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.984761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7482019c-8c3d-47c6-8d6b-0bc1c100d27f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.984852] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7482019c-8c3d-47c6-8d6b-0bc1c100d27f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.193735] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.193735] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.193735] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.193735] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.193735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.194395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.194395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.194395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.194395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.194395] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.344730] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6398991b-d5ff-4f53-a138-3545155245b1 in Status: SUCCESS [ 723.345331] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6398991b-d5ff-4f53-a138-3545155245b1 deletion is rescheduled due to dependency. [ 723.350022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.384069] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 723.384406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.384493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.384737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.384928] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.385062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.385132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.385276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.385365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.385494] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.391149] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 723.391526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.391623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.391884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.392079] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.392843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.392952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.393189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.393253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.393366] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.445034] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.445199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.490342] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7482019c-8c3d-47c6-8d6b-0bc1c100d27f [ 723.490578] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.490713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.490811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.491067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.491126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.491280] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7482019c-8c3d-47c6-8d6b-0bc1c100d27f already deleted. [ 723.491379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7482019c-8c3d-47c6-8d6b-0bc1c100d27f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.697645] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1440c9a-5782-4214-aa24-1446e4f91d71: rpc.has_security_group_logging(os_id): False [ 723.720221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.720221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.720221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.720221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.720221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.721011] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.721298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.721400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.721583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.721683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.721998] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.722148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.722214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.722393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.722465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.723196] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.723376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.723469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.723629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.723722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.723796] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1440c9a-5782-4214-aa24-1446e4f91d71 is going to be created. [ 723.796591] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.797119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.797291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.797701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.797954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.812292] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1440c9a-5782-4214-aa24-1446e4f91d71 in Status: IN_PROGRESS for 2s [ 723.823747] env[69274]: INFO networking_nsxv3.common.synchronization [req-9a579ae8-5b8a-4c21-b9fd-bb4b72a4c301 req-d3dad983-cd2d-4466-814b-296716e7904c tempest-ServersTestFqdnHostnames-1855747695 tempest-ServersTestFqdnHostnames-1855747695-project-member] Enqueued Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_members [ 723.828044] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGHEST for action security_group_members [ 723.828044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.828044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.828044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.828044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.828044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.828044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.828044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.828044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.828550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.828550] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.899226] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.899226] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.264868] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: SUCCESS [ 724.265236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.334041] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.334250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.334326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.334590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.334692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.334907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.335044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.335125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.335328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.335423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.335528] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b is going to be updated. [ 724.372815] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.374589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.374589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.374589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.374589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.402030] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.402614] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.409801] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b in Status: IN_PROGRESS for 2s [ 724.559285] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c298c4c-d013-4bb7-9c9d-037ccbdb3e6c req-50af00d0-2a17-44f9-9166-15671518c6b9 tempest-ServerMetadataTestJSON-658680684 tempest-ServerMetadataTestJSON-658680684-project-member] Enqueued Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_members [ 724.559285] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_members [ 724.559285] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.559285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.559285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.559687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.560336] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.560336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.560336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.560336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.560336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.560668] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.904305] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.904479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.904552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.904775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.904867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.904970] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be updated. [ 724.907861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.908108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.908108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.908270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.908368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.908464] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 724.939293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.939293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.939558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.939713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.939908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.952185] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: IN_PROGRESS for 2s [ 724.952923] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 725.014557] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-685 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.014744] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-685" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.014982] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-685" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.015483] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-685" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.016084] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.016359] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.016560] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.016939] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.017217] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.017556] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.019017] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.019017] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.019017] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.019017] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.019017] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.019017] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.055086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.055086] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.055086] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.055292] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-685" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.055477] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.055675] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.055803] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.056123] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.056258] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9006216e-0e75-4b14-b0c3-7dff6cfc98b0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.065740] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.065971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.066065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.066286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.066380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.067213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.067324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.067394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.067569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.067653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.067751] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 already deleted. [ 725.067839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.260143] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b72f335f-3c1e-426a-897f-35ba70c4b79b None None] Enqueued Resource ID: c27f788d-0adb-4200-8aeb-6375a9e5f468 with Priority: HIGHEST for action port [ 725.260553] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27f788d-0adb-4200-8aeb-6375a9e5f468 with Priority: HIGHEST for action port [ 725.261055] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c27f788d-0adb-4200-8aeb-6375a9e5f468 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.261694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c27f788d-0adb-4200-8aeb-6375a9e5f468" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.261694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c27f788d-0adb-4200-8aeb-6375a9e5f468" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.261694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c27f788d-0adb-4200-8aeb-6375a9e5f468" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.261694] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c27f788d-0adb-4200-8aeb-6375a9e5f468',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.559442] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.559857] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.559970] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.560358] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.560597] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.560680] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 9006216e-0e75-4b14-b0c3-7dff6cfc98b0 not found, creating... [ 725.561588] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.561780] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.561951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.562656] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.562656] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.562822] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.562891] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.563276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.563276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.563351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.563913] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 9006216e-0e75-4b14-b0c3-7dff6cfc98b0 is going to be created. [ 725.585362] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.585676] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.585876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.586285] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.586565] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.586841] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.767820] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c27f788d-0adb-4200-8aeb-6375a9e5f468 [ 725.769086] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.769086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.769086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.769086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.769086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.769086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c27f788d-0adb-4200-8aeb-6375a9e5f468 already deleted. [ 725.769421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c27f788d-0adb-4200-8aeb-6375a9e5f468" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.841672] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1440c9a-5782-4214-aa24-1446e4f91d71 in Status: SUCCESS [ 725.841672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.424188] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b in Status: SUCCESS [ 726.424448] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b deletion is rescheduled due to dependency. [ 726.424570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.643826] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c298c4c-d013-4bb7-9c9d-037ccbdb3e6c req-4b891714-90d3-41e5-a701-7121dfe9aaf5 service nova] Enqueued Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_rules [ 726.644122] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c298c4c-d013-4bb7-9c9d-037ccbdb3e6c req-4b891714-90d3-41e5-a701-7121dfe9aaf5 service nova] Enqueued Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_members [ 726.644229] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c298c4c-d013-4bb7-9c9d-037ccbdb3e6c req-4b891714-90d3-41e5-a701-7121dfe9aaf5 service nova] Enqueued Resource ID: 9006216e-0e75-4b14-b0c3-7dff6cfc98b0 with Priority: HIGHEST for action port [ 726.644485] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_rules [ 726.644619] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_members [ 726.644768] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9006216e-0e75-4b14-b0c3-7dff6cfc98b0 with Priority: HIGHEST for action port [ 726.646607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.646795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.646915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.647158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.647252] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.648118] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.648239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.649035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.649345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.649512] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.649618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.649687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.649853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.649946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.651027] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.653494] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.653594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.653594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.653765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.653846] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9006216e-0e75-4b14-b0c3-7dff6cfc98b0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.965141] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 726.965432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.965690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.966062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.966606] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.966606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.966606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.966750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.966876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.967013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.967362] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.971483] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.971483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.971483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.971483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.971483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.971994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.971994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.971994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.971994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.972204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.972204] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.095280] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3f5c72a9-1d89-4fa6-845c-a517ec347e64 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_rules [ 727.095489] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_rules [ 727.095797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.095922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.096131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.098048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.098048] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.155471] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.157520] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.157520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.157520] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9006216e-0e75-4b14-b0c3-7dff6cfc98b0 with status ACTIVE [ 727.157520] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.157520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.157520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.157520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.157520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.158161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.158161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.158161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.158161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.158161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.158313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.161951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.161951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.162068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.162291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.162291] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9006216e-0e75-4b14-b0c3-7dff6cfc98b0 is going to be updated. [ 727.193465] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.193465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.193465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.193465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.193465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.193465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9006216e-0e75-4b14-b0c3-7dff6cfc98b0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.476730] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.476730] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0551ddf-e014-4e0b-b17c-9e30f1dac015: rpc.has_security_group_logging(os_id): False [ 727.499838] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.500074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.500161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.504022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.504022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.504022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.504022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.504733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.504733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.504733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.504733] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 727.553679] env[69274]: INFO networking_nsxv3.common.synchronization [None req-d1d006a1-acf1-451e-b52b-76b8d1b1dc0c tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_rules [ 727.553679] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_rules [ 727.554820] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.554937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.602180] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.602180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.602180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.602180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.602180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.622261] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 727.637768] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.638734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.638902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.639664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.639664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.639664] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 already deleted. [ 727.639664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.640165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.640390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.640514] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.664537] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.979232] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cebac9fe-4ea0-40a1-a949-d690687274d0: rpc.has_security_group_logging(os_id): False [ 727.998417] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.998417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.998599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.999484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.999484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.999484] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.999484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.999484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.999798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.999798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.999798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be updated. [ 728.103936] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.103936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.103936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.103936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.103936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.142168] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: IN_PROGRESS for 2s [ 728.169433] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.169433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.169433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.169433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.169433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.169686] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 already deleted. [ 728.169686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.169924] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.170084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.170288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.170392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.170488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.170585] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 is going to be created. [ 728.237138] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.237302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.237375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.237600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.237764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.252267] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 in Status: UNINITIALIZED for 2s [ 728.322241] env[69274]: INFO networking_nsxv3.common.synchronization [None req-9352b260-e81a-4a20-b6fd-5085caf522fd None None] Enqueued Resource ID: 10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca with Priority: HIGHEST for action port [ 728.322903] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca with Priority: HIGHEST for action port [ 728.323167] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.323298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.323368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.323643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.323734] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.828512] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca [ 728.828987] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.828987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.829124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.829265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.829366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.829505] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca already deleted. [ 728.829642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10cf1cd2-58dc-4a62-a2c5-db1feb9e6cca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.641221] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 729.641482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.641870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.642093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.642231] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.146879] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.146879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.146879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.146879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.147463] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.147463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.147463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.147463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.147463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.147463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.147681] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.162036] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 730.162036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.269641] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 in Status: SUCCESS [ 730.270014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.270286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.270558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.274027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.274027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.274027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.274027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.274027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.274027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.274027] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.656232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.656232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.656232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.656232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.656232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.656756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.656756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.656756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.656756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.656756] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.779019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.779019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.779019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.779019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.779019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.779715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.779715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.779715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.779715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.779715] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.158846] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0551ddf-e014-4e0b-b17c-9e30f1dac015: rpc.has_security_group_logging(os_id): False [ 731.187153] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.187374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.187374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.187668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.187837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.188274] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.188435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.188504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.188802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.189198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.189828] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.190122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.190164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.190444] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.190654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.191079] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.191216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.191300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.191486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.191619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.191731] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 731.282675] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3522e3c-b40f-4d43-97bb-6926b26f91d0: rpc.has_security_group_logging(os_id): False [ 731.332601] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.332814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.333936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.333936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.333936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.333936] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.333936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.333936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.336490] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.336490] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.336490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.336490] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 is going to be created. [ 731.370010] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.370256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.370332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.370557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.370863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.400983] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 731.461287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.461528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.461594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.461898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.462208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.481118] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 in Status: IN_PROGRESS for 2s [ 733.324359] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 733.324668] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 733.418843] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 733.419315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.496106] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 in Status: SUCCESS [ 733.496473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.969366] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3c69e1c4-8757-42d0-82ce-b85d01f34380 None None] Enqueued Resource ID: 9b361042-d83b-4636-b1a9-a505669421ca with Priority: HIGHEST for action port [ 736.970955] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b361042-d83b-4636-b1a9-a505669421ca with Priority: HIGHEST for action port [ 736.971328] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b361042-d83b-4636-b1a9-a505669421ca taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.971477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b361042-d83b-4636-b1a9-a505669421ca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.971571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b361042-d83b-4636-b1a9-a505669421ca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.971825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b361042-d83b-4636-b1a9-a505669421ca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.971931] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b361042-d83b-4636-b1a9-a505669421ca',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.336391] env[69274]: INFO networking_nsxv3.common.synchronization [req-7a245025-5ed1-42eb-a22b-e4bd8b825265 req-d870a89a-09ca-4fd9-a845-11fab7524ac2 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 737.336987] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 737.338069] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.338196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.338196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.338978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.338978] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.339133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.339133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.339396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.339396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.339488] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.474676] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b361042-d83b-4636-b1a9-a505669421ca [ 737.474935] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.475118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.475200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.475429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.475539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.475647] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b361042-d83b-4636-b1a9-a505669421ca already deleted. [ 737.475729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b361042-d83b-4636-b1a9-a505669421ca" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.843118] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.843118] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.843118] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 already deleted. [ 737.843118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.117142] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.117142] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.117142] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.117142] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.119037] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.119037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.119037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.119037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.119037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.119423] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.119423] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.119493] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.119625] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.119806] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.119860] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.120015] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.145407] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.145635] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.145808] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.146074] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.146498] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-7f40e004-b664-4789-9acd-7918472ee9d1 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.146697] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.146825] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.147161] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.147306] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f40e004-b664-4789-9acd-7918472ee9d1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.651499] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.651701] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.651822] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.652165] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.653326] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.653326] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 7f40e004-b664-4789-9acd-7918472ee9d1 not found, creating... [ 738.653326] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.653326] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.653326] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.653637] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.653746] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.655490] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.655692] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.655821] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.656155] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.656325] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.656646] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 7f40e004-b664-4789-9acd-7918472ee9d1 is going to be created. [ 738.681536] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.681812] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.681930] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.682199] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.682427] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.682667] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.957099] env[69274]: INFO networking_nsxv3.common.synchronization [None req-bf37bda7-9a88-4872-bcfa-d30276b77d40 None None] Enqueued Resource ID: 361a4372-dd74-4e49-9e18-43a4cfa608db with Priority: HIGHEST for action port [ 738.957922] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361a4372-dd74-4e49-9e18-43a4cfa608db with Priority: HIGHEST for action port [ 738.958478] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-361a4372-dd74-4e49-9e18-43a4cfa608db taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.958478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-361a4372-dd74-4e49-9e18-43a4cfa608db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.958617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-361a4372-dd74-4e49-9e18-43a4cfa608db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.958848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-361a4372-dd74-4e49-9e18-43a4cfa608db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.958965] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('361a4372-dd74-4e49-9e18-43a4cfa608db',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.462143] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 361a4372-dd74-4e49-9e18-43a4cfa608db [ 739.462489] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.462575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.462616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.462848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.462945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.463058] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:361a4372-dd74-4e49-9e18-43a4cfa608db already deleted. [ 739.463147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-361a4372-dd74-4e49-9e18-43a4cfa608db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.585755] env[69274]: INFO networking_nsxv3.common.synchronization [req-7a245025-5ed1-42eb-a22b-e4bd8b825265 req-73f86098-c354-4de3-836b-1c9c00f4b686 service nova] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 739.585950] env[69274]: INFO networking_nsxv3.common.synchronization [req-7a245025-5ed1-42eb-a22b-e4bd8b825265 req-73f86098-c354-4de3-836b-1c9c00f4b686 service nova] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 739.586108] env[69274]: INFO networking_nsxv3.common.synchronization [req-7a245025-5ed1-42eb-a22b-e4bd8b825265 req-73f86098-c354-4de3-836b-1c9c00f4b686 service nova] Enqueued Resource ID: 7f40e004-b664-4789-9acd-7918472ee9d1 with Priority: HIGHEST for action port [ 739.588028] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 739.588253] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 739.588414] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f40e004-b664-4789-9acd-7918472ee9d1 with Priority: HIGHEST for action port [ 739.590144] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.590313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.590390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.590604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.590692] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.591751] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.591875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.591969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.592203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.592347] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.592444] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.592511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.592651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.592752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.592861] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.593615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f40e004-b664-4789-9acd-7918472ee9d1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.594914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.595034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.595200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.595284] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f40e004-b664-4789-9acd-7918472ee9d1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.764174] env[69274]: INFO networking_nsxv3.common.synchronization [req-407a9925-d88b-45a2-b6a5-cb8261d9e0a5 req-7184f6ba-4baf-4a8b-976d-f1ae1192da27 tempest-FloatingIPsAssociationNegativeTestJSON-526268844 tempest-FloatingIPsAssociationNegativeTestJSON-526268844-project-member] Enqueued Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_members [ 739.765633] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGHEST for action security_group_members [ 739.771042] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a5d634a-b1be-42a4-99e4-7a9287773266 req-84edc96f-3f41-4799-a15c-416f6e0fae90 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 739.771042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.771042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.771042] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.771042] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 739.771042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.771042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.771042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.771853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.771853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.771853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.771853] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.097230] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.098519] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.098633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.098789] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f40e004-b664-4789-9acd-7918472ee9d1 with status ACTIVE [ 740.098971] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.099180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.099180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.099383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.099465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.099614] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.099713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.099769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.099907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.099990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.100405] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.100405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.100689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.100689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.100689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.100952] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f40e004-b664-4789-9acd-7918472ee9d1 is going to be updated. [ 740.126213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.126213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.126213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.126213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.126213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.126213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f40e004-b664-4789-9acd-7918472ee9d1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.192301] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.192423] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.192563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.194059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.194059] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.194059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.194059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.194059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.194059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.194460] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.194460] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.194460] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.194712] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.194712] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.194834] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.194949] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.223840] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.223949] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.224079] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.224268] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.224585] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.224797] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.224928] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.225351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.225901] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a541e0-e5ea-49e4-b098-1cc95b65c23d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.274397] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.275128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.277887] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.277887] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1440c9a-5782-4214-aa24-1446e4f91d71 is going to be updated. [ 740.277887] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.277887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.278513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.279454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.279454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.279454] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.279454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.279454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.279454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.279454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.280544] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 740.307235] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.307379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.307428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.308033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.308033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.311944] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.312148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.312305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.312504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.312676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.323949] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 740.324844] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1440c9a-5782-4214-aa24-1446e4f91d71 in Status: IN_PROGRESS for 2s [ 740.605208] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.731164] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.731390] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.731514] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.731792] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.731941] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.732105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b4a541e0-e5ea-49e4-b098-1cc95b65c23d not found, creating... [ 740.732413] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.732603] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.732747] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.732993] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.733155] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.733455] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.733608] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.736194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.736194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.736194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.736194] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b4a541e0-e5ea-49e4-b098-1cc95b65c23d is going to be created. [ 740.755259] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.755526] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.755663] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.755941] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.756188] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.756418] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.107619] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.108159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.108240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.108515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.108749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.108901] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be created. [ 741.134794] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.134794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.134794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.134794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.134794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.143918] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: UNINITIALIZED for 2s [ 741.520539] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a5d634a-b1be-42a4-99e4-7a9287773266 req-766876a8-af7d-4146-914a-b6b78d5de494 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 741.520730] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a5d634a-b1be-42a4-99e4-7a9287773266 req-766876a8-af7d-4146-914a-b6b78d5de494 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 741.520869] env[69274]: INFO networking_nsxv3.common.synchronization [req-2a5d634a-b1be-42a4-99e4-7a9287773266 req-766876a8-af7d-4146-914a-b6b78d5de494 service nova] Enqueued Resource ID: b4a541e0-e5ea-49e4-b098-1cc95b65c23d with Priority: HIGHEST for action port [ 741.521268] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 741.521361] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 741.521454] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a541e0-e5ea-49e4-b098-1cc95b65c23d with Priority: HIGHEST for action port [ 741.522056] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.522156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.522198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.522386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.522471] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.523683] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.525967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.525967] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.525967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.525967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.525967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.525967] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a541e0-e5ea-49e4-b098-1cc95b65c23d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.031156] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.031440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.033817] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4a541e0-e5ea-49e4-b098-1cc95b65c23d with status ACTIVE [ 742.034020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.034148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.034827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.034827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.034827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.034827] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.034827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.034827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.036204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.036204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.036204] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.036204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.036204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.036204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.036204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.036204] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4a541e0-e5ea-49e4-b098-1cc95b65c23d is going to be updated. [ 742.057967] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.058206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.058282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.058491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.058644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.058858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4a541e0-e5ea-49e4-b098-1cc95b65c23d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.336176] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 742.336402] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 742.336488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.337503] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1440c9a-5782-4214-aa24-1446e4f91d71 in Status: SUCCESS [ 742.337503] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1440c9a-5782-4214-aa24-1446e4f91d71 deletion is rescheduled due to dependency. [ 742.337503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.337747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.337838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.338037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.338163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.338227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.338394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.338474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.338571] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.636542] env[69274]: INFO networking_nsxv3.common.synchronization [req-e055538b-6ed9-4968-b4a1-0a95b9bc6abb req-0745f814-0aa3-414c-8006-2f8279485953 tempest-ServersAdminNegativeTestJSON-1537378782 tempest-ServersAdminNegativeTestJSON-1537378782-project-member] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 742.637214] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 742.637546] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.637666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.637738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.637986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.642230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.642464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.642464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.642645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.642744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.642847] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.841028] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.994452] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.994656] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.994782] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.995060] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.995375] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.995548] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.995668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.995891] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.996550] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.996806] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.996928] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.997092] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.997212] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.997328] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.997437] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.997570] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.016859] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.017136] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.017349] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.017553] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.017867] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.018054] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.018181] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.018507] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.018650] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4577a578-80d5-4c3b-8448-c9b7ef3cbd55',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.146118] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.157939] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: UNINITIALIZED for 4s [ 743.342748] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.522412] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.522412] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.522412] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.522412] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.522412] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.522412] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 4577a578-80d5-4c3b-8448-c9b7ef3cbd55 not found, creating... [ 743.522412] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.522847] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.522847] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.522910] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.523018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.523328] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.523506] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.523641] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.523868] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.524025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.524176] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 4577a578-80d5-4c3b-8448-c9b7ef3cbd55 is going to be created. [ 743.546558] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.546804] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.546938] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.547284] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.547541] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.547786] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.648386] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.844893] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.845095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.845151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.845437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.845437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.845575] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 743.880264] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.880264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.880264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.880264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.880264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.887993] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 744.150818] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.151190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.151190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.151322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.151420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.151525] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be updated. [ 744.181914] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.182172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.182172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.182390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.182528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.191928] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: IN_PROGRESS for 2s [ 744.429852] env[69274]: INFO networking_nsxv3.common.synchronization [req-e055538b-6ed9-4968-b4a1-0a95b9bc6abb req-4ad47199-d38b-4a8a-80ad-845ecf40e79f service nova] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_rules [ 744.430185] env[69274]: INFO networking_nsxv3.common.synchronization [req-e055538b-6ed9-4968-b4a1-0a95b9bc6abb req-4ad47199-d38b-4a8a-80ad-845ecf40e79f service nova] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 744.430564] env[69274]: INFO networking_nsxv3.common.synchronization [req-e055538b-6ed9-4968-b4a1-0a95b9bc6abb req-4ad47199-d38b-4a8a-80ad-845ecf40e79f service nova] Enqueued Resource ID: 4577a578-80d5-4c3b-8448-c9b7ef3cbd55 with Priority: HIGHEST for action port [ 744.431132] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_rules [ 744.431376] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 744.431445] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4577a578-80d5-4c3b-8448-c9b7ef3cbd55 with Priority: HIGHEST for action port [ 744.431785] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.431961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.432147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.432669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.432669] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.433625] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.433755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.433951] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.434116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.434191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.435665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.435832] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4577a578-80d5-4c3b-8448-c9b7ef3cbd55',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.539020] env[69274]: INFO networking_nsxv3.common.synchronization [req-e89ee8f1-0700-4096-8415-2e942d71799f req-06255071-cca6-4c5c-8db8-2416ff067522 tempest-ListImageFiltersTestJSON-1188695543 tempest-ListImageFiltersTestJSON-1188695543-project-member] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 744.539702] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 744.540039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.540171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.540236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.540447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.540604] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.541090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.541090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.541090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.541090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.541334] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.659070] env[69274]: INFO networking_nsxv3.common.synchronization [req-0d379d0b-77b0-4c5f-9347-51081b100f4a req-66da51e3-f441-4f01-8baf-5a012d9b2d2b tempest-ServerMetadataTestJSON-658680684 tempest-ServerMetadataTestJSON-658680684-project-member] Enqueued Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_members [ 744.663258] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGHEST for action security_group_members [ 744.663258] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.663258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.663258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.663258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.663258] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.663258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.663258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.663258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.663258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.663258] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.939878] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.940069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.944443] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4577a578-80d5-4c3b-8448-c9b7ef3cbd55 with status ACTIVE [ 744.944719] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.944854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.944952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.945303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.945417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.945626] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.945736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.945801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.945970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.946064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.946247] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.946343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.946406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.946547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.946623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.946709] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4577a578-80d5-4c3b-8448-c9b7ef3cbd55 is going to be updated. [ 744.969741] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.969885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.969885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.970095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.970288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.970458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4577a578-80d5-4c3b-8448-c9b7ef3cbd55" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.044945] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.164611] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.164982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.164982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.165070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.165175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.165568] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.165568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.165568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.165834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.165834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.165893] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 is going to be updated. [ 745.168497] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: SUCCESS [ 745.168497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.168497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.169103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.169103] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.169103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.169103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.169103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.169337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.169337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.169337] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.199682] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.199682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.199682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.199682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.199682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.208031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 in Status: IN_PROGRESS for 2s [ 745.546970] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.671050] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.898795] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 745.899076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.899278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.899506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.899775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.899829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.899883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.900028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.900117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.900206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.900301] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.049752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.049940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.050030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.050279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.050480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.050602] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be updated. [ 746.079287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.079424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.079519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.079723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.079868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.090303] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: IN_PROGRESS for 2s [ 746.173478] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 833fffe2-1aa6-4f10-9ea0-4e315ed92177: rpc.has_security_group_logging(os_id): False [ 746.199740] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.199914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.200010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.200302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.200438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.200743] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.200875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.200949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.201254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.201350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.201445] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be created. [ 746.205065] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: SUCCESS [ 746.205065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.205065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.205065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.205065] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.205065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.205065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.205427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.205427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.205427] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.299409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.299838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.299838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.300218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.300423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.311905] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: IN_PROGRESS for 2s [ 746.402576] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.403684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.403684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.403684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.403684] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.403684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.403993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.404189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.404326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.404472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.404672] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.404864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.404971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.405175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.405408] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.405550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.405651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.405833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.405957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.407175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.407175] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.712436] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.909489] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c216e0c6-b262-4569-8d09-772eeaa39501: rpc.has_security_group_logging(os_id): False [ 746.926964] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.927141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.927218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.927440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.927540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.927752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.928059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.928133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.928296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.928381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.928970] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.928970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.928970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.928970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.928970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.929241] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.929342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.929408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.929553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.929635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.929724] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 747.002912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.003084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.003148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.003371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.003508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.016963] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 747.213750] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.218012] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 in Status: SUCCESS [ 747.218183] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 deletion is rescheduled due to dependency. [ 747.218297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.717780] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.717932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.718012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.718247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.718337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.718675] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be updated. [ 747.755956] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.757491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.757491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.757491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.757491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.769164] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: IN_PROGRESS for 2s [ 748.101583] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: SUCCESS [ 748.101805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.330324] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: SUCCESS [ 748.330671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.031022] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 749.031287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.662039] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 749.662392] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 749.780296] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: SUCCESS [ 749.780590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.780590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.780814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.781088] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.781218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.781218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.781386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.781469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.781552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.781647] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.283794] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.284041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.284176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.284398] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.284580] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.284694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.284756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.285642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.285776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.285920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.286100] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.286203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.286263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.286439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.286591] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.286686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.286749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.286887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.286966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.287073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.287153] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.789629] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59b1a355-727a-429c-8793-e86ce70f75b8: rpc.has_security_group_logging(os_id): False [ 750.807091] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.807252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.807333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.807534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.807629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.807819] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.807916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.807981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.808140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.808221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.808417] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.808508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.808560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.808699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.808774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.808966] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.810155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.811063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.811063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.811063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.811063] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be updated. [ 750.876039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.876213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.876293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.876701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.876701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.892774] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: IN_PROGRESS for 2s [ 752.907669] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: SUCCESS [ 752.907933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.664251] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 754.664251] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 758.623222] env[69274]: INFO networking_nsxv3.common.synchronization [req-e816edec-27ef-4f0b-84b4-a0411c7a5925 req-46b35201-b0ba-43d9-9cd1-aaf7aaa0a503 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 758.624592] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 758.627447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.627447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.627447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.627447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.627447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.627447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.627447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.627447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.627447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.627447] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.081806] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-338 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.083871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-338" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.083871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-338" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.083871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-338" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.083871] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.083871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.083871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.083871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.083871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.083871] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.083871] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.083871] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.083871] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.084441] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.084441] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.084441] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.106825] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.106969] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.107188] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.108194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-338" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.108194] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-725820e7-6c36-42a7-b348-480790c19a52 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.108194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.108194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.108447] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.108447] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725820e7-6c36-42a7-b348-480790c19a52',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.134745] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.135186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.135186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.135329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.135429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.135644] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.135755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.135822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.135977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.136071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.136162] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 already deleted. [ 759.136248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.615026] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.615026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 725820e7-6c36-42a7-b348-480790c19a52 not found, creating... [ 759.615026] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.615026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.616000] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.616000] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.616248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.616604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.616941] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.617232] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 725820e7-6c36-42a7-b348-480790c19a52 is going to be created. [ 759.640148] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.640148] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.640148] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.640148] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.640148] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.640148] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.410925] env[69274]: INFO networking_nsxv3.common.synchronization [req-225df650-3e01-4734-beed-da479f16b44e req-8006584e-6086-43b2-9ee5-71d1c19323ff tempest-ServersAdminNegativeTestJSON-1537378782 tempest-ServersAdminNegativeTestJSON-1537378782-project-member] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 760.411528] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 760.411835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.411987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.412063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.412324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.412487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.412585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.412647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.412801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.412889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.412981] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.540583] env[69274]: INFO networking_nsxv3.common.synchronization [req-e816edec-27ef-4f0b-84b4-a0411c7a5925 req-42abac75-2111-497c-bb1c-41c86870854c service nova] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 760.540717] env[69274]: INFO networking_nsxv3.common.synchronization [req-e816edec-27ef-4f0b-84b4-a0411c7a5925 req-42abac75-2111-497c-bb1c-41c86870854c service nova] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 760.540872] env[69274]: INFO networking_nsxv3.common.synchronization [req-e816edec-27ef-4f0b-84b4-a0411c7a5925 req-42abac75-2111-497c-bb1c-41c86870854c service nova] Enqueued Resource ID: 725820e7-6c36-42a7-b348-480790c19a52 with Priority: HIGHEST for action port [ 760.541488] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 760.541638] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 760.541739] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725820e7-6c36-42a7-b348-480790c19a52 with Priority: HIGHEST for action port [ 760.542015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.543277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.543355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.543568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.543664] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.544545] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.544687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.544784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.544975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.545142] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.545231] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.545305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.545437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.545526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.545615] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.547355] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-725820e7-6c36-42a7-b348-480790c19a52 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.547485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.547554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.547715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.547793] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725820e7-6c36-42a7-b348-480790c19a52',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.916629] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.035324] env[69274]: INFO networking_nsxv3.common.synchronization [req-5420695f-66de-4334-820b-90304f7f6dcd req-fab7307c-1918-4c87-95b2-be7718972814 tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 761.035929] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 761.036247] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.036364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.036428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.036673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.036819] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.036915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.036974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.037134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.037217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.037308] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.051425] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.051539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.051731] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.053062] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 725820e7-6c36-42a7-b348-480790c19a52 with status ACTIVE [ 761.053254] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.053554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.053554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.053657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.053782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.053972] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.058035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.058035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.058035] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 725820e7-6c36-42a7-b348-480790c19a52 is going to be updated. [ 761.084439] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.084439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.084439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.084439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.084439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.084439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.425022] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.527052] env[69274]: INFO networking_nsxv3.common.synchronization [req-73bcf6f2-e1a9-486e-a7c2-dfe1bff0961b req-da0b4df7-bff1-4cba-a264-52f12be3e2d3 tempest-FloatingIPsAssociationTestJSON-1878357021 tempest-FloatingIPsAssociationTestJSON-1878357021-project-member] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 761.527882] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGHEST for action security_group_members [ 761.527968] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.528482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.528605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.529068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.529172] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.529244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.529312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.529506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.529595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.529691] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.543350] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.544029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.544029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.544184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.544565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.544625] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.545134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.545134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.545134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.545134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.545349] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 already deleted. [ 761.545475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.559243] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.619614] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.621187] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.621355] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.621759] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.622059] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.622430] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.622565] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.622829] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.623062] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.623311] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.623442] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.623586] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.623722] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.623849] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.623960] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.624115] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.646052] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.646052] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.646252] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.646342] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.646655] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b598aec0-f4f7-4182-9103-c21283f7b671 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.646828] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.646949] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.647301] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.647443] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b598aec0-f4f7-4182-9103-c21283f7b671',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.927977] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.929031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.929031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.929031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.929031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.929031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be updated. [ 761.961382] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.961586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.961623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.962771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.962956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.975406] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: IN_PROGRESS for 2s [ 762.032236] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.032499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.032621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.032980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.033142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.033443] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.033615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.033726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.033983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.034146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.034275] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be updated. [ 762.063024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.063024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.063024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.063024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.063024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.063024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be created. [ 762.096325] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.096521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.096723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.096992] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.097270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.103400] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.103400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.103400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.103400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.103400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111171] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: IN_PROGRESS for 2s [ 762.112734] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: UNINITIALIZED for 2s [ 762.150257] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.150730] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.150877] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.151297] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.151538] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.151720] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b598aec0-f4f7-4182-9103-c21283f7b671 not found, creating... [ 762.152015] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.152190] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.152312] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.152555] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.152697] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.152996] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.153220] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.153371] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.153628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.153778] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.153922] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b598aec0-f4f7-4182-9103-c21283f7b671 is going to be created. [ 762.178731] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.178973] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.179162] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.179463] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.179694] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.179931] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.912732] env[69274]: INFO networking_nsxv3.common.synchronization [req-5420695f-66de-4334-820b-90304f7f6dcd req-bb82efd1-0ae2-4c00-952c-700d21a25b00 service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 762.912925] env[69274]: INFO networking_nsxv3.common.synchronization [req-5420695f-66de-4334-820b-90304f7f6dcd req-bb82efd1-0ae2-4c00-952c-700d21a25b00 service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 762.913077] env[69274]: INFO networking_nsxv3.common.synchronization [req-5420695f-66de-4334-820b-90304f7f6dcd req-bb82efd1-0ae2-4c00-952c-700d21a25b00 service nova] Enqueued Resource ID: b598aec0-f4f7-4182-9103-c21283f7b671 with Priority: HIGHEST for action port [ 762.913640] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 762.916752] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 762.916923] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b598aec0-f4f7-4182-9103-c21283f7b671 with Priority: HIGHEST for action port [ 762.917221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.917349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.917479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.917618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.918116] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.921325] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.921325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.921325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.921325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.921325] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.921325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.921325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.921325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.921325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.921325] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.921325] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b598aec0-f4f7-4182-9103-c21283f7b671 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.921838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.921838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.921838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.921838] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b598aec0-f4f7-4182-9103-c21283f7b671',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.426535] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.426970] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.426970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.427080] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b598aec0-f4f7-4182-9103-c21283f7b671 with status ACTIVE [ 763.428511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.428511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.428511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.429202] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.429202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.429202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.429202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.429202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.429202] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b598aec0-f4f7-4182-9103-c21283f7b671 is going to be updated. [ 763.451908] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.452107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.452424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.452500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.452649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.452848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b598aec0-f4f7-4182-9103-c21283f7b671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.723690] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b7ba26b1-bfbf-4155-a081-8358718faee8 tempest-MigrationsAdminTest-608694291 tempest-MigrationsAdminTest-608694291-project-member] Enqueued Resource ID: 79bde9ae-e1e5-4c08-b91b-533841cf59e9 with Priority: HIGHEST for action security_group_rules [ 763.724341] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79bde9ae-e1e5-4c08-b91b-533841cf59e9 with Priority: HIGHEST for action security_group_rules [ 763.724605] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.725070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.725146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.725388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.725477] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79bde9ae-e1e5-4c08-b91b-533841cf59e9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.822845] env[69274]: INFO networking_nsxv3.common.synchronization [None req-e1792e89-0135-48dd-b2be-29e4f9e33e38 tempest-MigrationsAdminTest-608694291 tempest-MigrationsAdminTest-608694291-project-member] Enqueued Resource ID: 79bde9ae-e1e5-4c08-b91b-533841cf59e9 with Priority: HIGHEST for action security_group_rules [ 763.823767] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79bde9ae-e1e5-4c08-b91b-533841cf59e9 with Priority: HIGHEST for action security_group_rules [ 763.823844] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.823941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.931051] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.988929] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: SUCCESS [ 763.989117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.126448] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55f154d6-8c77-4554-a90c-034e9602b91b in Status: SUCCESS [ 764.131024] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b deletion is rescheduled due to dependency. [ 764.131024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.131024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: SUCCESS [ 764.131024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.131024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.131024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.131723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.132050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.132197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.132515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.132853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.133057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.133242] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.258232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.259156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.259156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.259156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.259156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.259156] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79bde9ae-e1e5-4c08-b91b-533841cf59e9 already deleted. [ 764.259156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.259156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.261653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.261653] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79bde9ae-e1e5-4c08-b91b-533841cf59e9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.433522] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.433820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.433820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.433989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.434095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.434198] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be created. [ 764.459015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.459159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.459159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.459721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.459721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.472593] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: UNINITIALIZED for 2s [ 764.636854] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.784363] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.784363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.784363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.784363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.784363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.784363] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79bde9ae-e1e5-4c08-b91b-533841cf59e9 already deleted. [ 764.785370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79bde9ae-e1e5-4c08-b91b-533841cf59e9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.139603] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82: rpc.has_security_group_logging(os_id): False [ 765.167170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.167439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.167439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.167636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.167731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.167996] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.168137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.168202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.168371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.168451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.168542] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be created. [ 765.279446] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.279712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.279895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.280114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.280388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.303471] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: IN_PROGRESS for 2s [ 766.306417] env[69274]: INFO networking_nsxv3.common.synchronization [req-76de3cb6-195b-40aa-8e86-fb6fae29416b req-810f581e-a87d-4650-b5a6-d2f2a68801cb tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 766.306946] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 766.307896] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.307896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.307896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.307896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.307896] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.307896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.307896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.308424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.308424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.308424] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.484447] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 766.484748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.484868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.485119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.485364] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.485534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.485594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.485790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.485910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.485999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.486114] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.738405] env[69274]: INFO networking_nsxv3.common.synchronization [req-19cfe88e-c19b-4aae-b0fb-c0b4c6ec996f req-85a586f2-12ad-42fb-a60f-aecda63a6f29 tempest-ServersNegativeTestJSON-1840850554 tempest-ServersNegativeTestJSON-1840850554-project-member] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 766.738405] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 766.738405] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.738405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.738405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.738405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.738405] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.738405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.738405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.738405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.739415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.739415] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.812714] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.812714] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.812714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.812714] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 766.842276] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.842440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.843655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.843655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.843655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.853124] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 766.988913] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.241036] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.319557] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: SUCCESS [ 767.319927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.495065] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15291f2b-281c-4bf0-a609-bcb369c82f51: rpc.has_security_group_logging(os_id): False [ 767.516751] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.516940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.517026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.517295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.517423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.517719] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.517832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.517919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.518105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.518206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.518300] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be created. [ 767.573842] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.574063] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.574199] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.574467] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.578440] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.578440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.578440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.578440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.578440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.578440] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.578775] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.581485] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.581636] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.581778] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.581896] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.582055] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.584702] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.584846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.584919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.586200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.586200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.604325] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 767.610070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.610267] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.610425] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.610622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.611043] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b53623dd-46a7-4fce-a1f2-91b74293e0b9 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.611401] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.611534] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.611913] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.612116] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b53623dd-46a7-4fce-a1f2-91b74293e0b9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.712306] env[69274]: INFO networking_nsxv3.common.synchronization [None req-47cb914f-f868-4411-acfb-2f21956a5a4f None None] Enqueued Resource ID: 31c763b6-6149-42ba-9300-220fa95f5778 with Priority: HIGHEST for action port [ 767.712306] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31c763b6-6149-42ba-9300-220fa95f5778 with Priority: HIGHEST for action port [ 767.712306] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-31c763b6-6149-42ba-9300-220fa95f5778 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.712306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31c763b6-6149-42ba-9300-220fa95f5778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.712306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31c763b6-6149-42ba-9300-220fa95f5778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.712306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31c763b6-6149-42ba-9300-220fa95f5778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.712306] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31c763b6-6149-42ba-9300-220fa95f5778',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.744021] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.119033] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.119033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.119033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.119033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.119033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.119033] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b53623dd-46a7-4fce-a1f2-91b74293e0b9 not found, creating... [ 768.119033] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.119033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.119033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.119606] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.119606] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.119956] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.121131] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.121131] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.121131] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.121131] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.121423] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b53623dd-46a7-4fce-a1f2-91b74293e0b9 is going to be created. [ 768.143725] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.144037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.144132] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.144382] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.144616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.144852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.213125] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31c763b6-6149-42ba-9300-220fa95f5778 [ 768.213436] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.213627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.213673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.213869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.213959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.214064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31c763b6-6149-42ba-9300-220fa95f5778 already deleted. [ 768.214146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31c763b6-6149-42ba-9300-220fa95f5778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.246370] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.246564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.246620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.246834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.246924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.247035] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be updated. [ 768.297377] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.297377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.297377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.297647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.298693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.314393] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 768.866023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 768.866343] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 768.866343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.121621] env[69274]: INFO networking_nsxv3.common.synchronization [req-19cfe88e-c19b-4aae-b0fb-c0b4c6ec996f req-04f3838e-67ca-46a1-b892-b89a7e062a43 service nova] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_rules [ 769.121982] env[69274]: INFO networking_nsxv3.common.synchronization [req-19cfe88e-c19b-4aae-b0fb-c0b4c6ec996f req-04f3838e-67ca-46a1-b892-b89a7e062a43 service nova] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 769.122587] env[69274]: INFO networking_nsxv3.common.synchronization [req-19cfe88e-c19b-4aae-b0fb-c0b4c6ec996f req-04f3838e-67ca-46a1-b892-b89a7e062a43 service nova] Enqueued Resource ID: b53623dd-46a7-4fce-a1f2-91b74293e0b9 with Priority: HIGHEST for action port [ 769.125049] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_rules [ 769.125049] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 769.125049] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b53623dd-46a7-4fce-a1f2-91b74293e0b9 with Priority: HIGHEST for action port [ 769.125049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.125049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.125049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.125564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.125564] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.126669] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.126768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.126961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b53623dd-46a7-4fce-a1f2-91b74293e0b9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.127184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.127184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.127423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.127506] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b53623dd-46a7-4fce-a1f2-91b74293e0b9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.599128] env[69274]: INFO networking_nsxv3.common.synchronization [req-334233fd-5efb-428b-8147-5427f5301cd7 req-a62a0a3d-cb01-4841-ba56-5b2efdfdd9d4 tempest-ServersTestManualDisk-1091924666 tempest-ServersTestManualDisk-1091924666-project-member] Enqueued Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_members [ 769.600182] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_members [ 769.600488] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.600678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.600766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.601069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.601381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.601504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.601589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.601841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.601973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.602381] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.621092] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 769.621413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.633035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.633035] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b53623dd-46a7-4fce-a1f2-91b74293e0b9 with status ACTIVE [ 769.633035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.633035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.633035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.633035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.633864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.633864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.633864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.633864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.633864] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b53623dd-46a7-4fce-a1f2-91b74293e0b9 is going to be updated. [ 769.662547] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.662547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.662547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.662923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.662959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.663183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b53623dd-46a7-4fce-a1f2-91b74293e0b9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.689260] env[69274]: INFO networking_nsxv3.common.synchronization [None req-e280a592-6aec-4833-b460-b9cfa2944986 None None] Enqueued Resource ID: 93b439ee-114b-47cd-8fc0-b5cc372faeb6 with Priority: HIGHEST for action port [ 769.689260] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93b439ee-114b-47cd-8fc0-b5cc372faeb6 with Priority: HIGHEST for action port [ 769.689260] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-93b439ee-114b-47cd-8fc0-b5cc372faeb6 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.689260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93b439ee-114b-47cd-8fc0-b5cc372faeb6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.689260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93b439ee-114b-47cd-8fc0-b5cc372faeb6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.689260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93b439ee-114b-47cd-8fc0-b5cc372faeb6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.689260] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93b439ee-114b-47cd-8fc0-b5cc372faeb6',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.080563] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.080563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.080563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.080563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.081101] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.082185] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.082185] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.082185] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.082185] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.082185] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.082185] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.082452] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.082452] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.082558] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.082590] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.083584] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.104115] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.104115] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.104115] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.104115] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.104115] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.104115] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.104115] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.104687] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.104962] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.106149] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.106416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.106587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.106852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.107045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.108110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.108110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.108110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.108110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.108110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.108110] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 already deleted. [ 770.108110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.197248] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93b439ee-114b-47cd-8fc0-b5cc372faeb6 [ 770.197248] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.197248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.197248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.197248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.197572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.197572] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93b439ee-114b-47cd-8fc0-b5cc372faeb6 already deleted. [ 770.197572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93b439ee-114b-47cd-8fc0-b5cc372faeb6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.327021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 770.327021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.327021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.327021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.327021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.327021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.327021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.327021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.327021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.327021] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.612527] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.612527] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac not found, creating... [ 770.612527] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.612527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.613488] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.613745] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.613926] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.614186] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.614400] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.614585] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac is going to be created. [ 770.639343] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.640725] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.640930] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.641276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.641528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.641767] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.830255] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.333035] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.817230] env[69274]: INFO networking_nsxv3.common.synchronization [req-334233fd-5efb-428b-8147-5427f5301cd7 req-239ba3a9-eb26-42f0-a58a-b1e72c6745d4 service nova] Enqueued Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_rules [ 771.817230] env[69274]: INFO networking_nsxv3.common.synchronization [req-334233fd-5efb-428b-8147-5427f5301cd7 req-239ba3a9-eb26-42f0-a58a-b1e72c6745d4 service nova] Enqueued Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_members [ 771.817230] env[69274]: INFO networking_nsxv3.common.synchronization [req-334233fd-5efb-428b-8147-5427f5301cd7 req-239ba3a9-eb26-42f0-a58a-b1e72c6745d4 service nova] Enqueued Resource ID: 8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac with Priority: HIGHEST for action port [ 771.817230] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_rules [ 771.817230] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_members [ 771.817230] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac with Priority: HIGHEST for action port [ 771.817230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.817230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.817230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.817230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.826024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.826024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.826024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.826024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.826024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.826024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.826024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.835932] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.836142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.836234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.836468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.836581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.836681] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be updated. [ 771.870193] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.870193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.870193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.870193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.870193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.878811] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 772.222106] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:0 completed [ 772.222328] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:1 started [ 772.333798] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.333798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.333798] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.334691] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac with status ACTIVE [ 772.335089] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.338979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.338979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.338979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.338979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.338979] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.339202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.339236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.339592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.339592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.339722] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.339844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.339884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.340019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.340096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.340182] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac is going to be updated. [ 772.361516] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.361716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.361790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.361973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.362130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.362326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bc0cedd-b68d-46d6-8ccf-15ebb4a8c6ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.791699] env[69274]: INFO networking_nsxv3.common.synchronization [None req-48920fbc-ed38-4c70-b7bc-29c8672ddcca None None] Enqueued Resource ID: 1dd3c112-fefe-4696-9be2-2f2b1f031c39 with Priority: HIGHEST for action port [ 772.792489] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dd3c112-fefe-4696-9be2-2f2b1f031c39 with Priority: HIGHEST for action port [ 772.793193] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dd3c112-fefe-4696-9be2-2f2b1f031c39 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.793524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dd3c112-fefe-4696-9be2-2f2b1f031c39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.793679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dd3c112-fefe-4696-9be2-2f2b1f031c39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.794324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dd3c112-fefe-4696-9be2-2f2b1f031c39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.794411] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dd3c112-fefe-4696-9be2-2f2b1f031c39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.835870] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.296464] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dd3c112-fefe-4696-9be2-2f2b1f031c39 [ 773.297300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.298214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.298325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.298584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.298681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.298789] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dd3c112-fefe-4696-9be2-2f2b1f031c39 already deleted. [ 773.298869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dd3c112-fefe-4696-9be2-2f2b1f031c39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.338569] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.338891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.338891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.339082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.339180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.339278] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 is going to be created. [ 773.365785] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.365785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.365785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.365785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.365785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.373994] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6c444ae-af25-4279-9215-0b11d2e72a27 in Status: UNINITIALIZED for 2s [ 773.761442] env[69274]: INFO networking_nsxv3.common.synchronization [req-1e1feee6-41c5-40ea-936f-4b915af7f88f req-3f9ee3c1-cc85-41ad-967c-299a2a599ae2 tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 773.765187] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 773.769938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.769938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.769938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.769938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.769938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.769938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.769938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.769938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.769938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.769938] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.892066] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 773.892066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.892066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.892336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.892403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.892530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.892593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.892748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.892829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.892924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.893021] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.275905] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.276119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.276190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.276423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.276518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.279937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.280102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.280182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.280419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.280516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.280618] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be updated. [ 774.287828] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-704 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.288083] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.288223] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.288498] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.289211] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.289393] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.289529] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.289829] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.289991] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.290228] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.290441] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.290441] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.290605] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.290666] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.290771] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.290907] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.324071] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.324252] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.324391] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.324823] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.325210] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-152f9fdc-a191-41d0-b581-229bf76cbd95 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.325398] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.325520] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.325864] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.325997] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152f9fdc-a191-41d0-b581-229bf76cbd95',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.341293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.341701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.341701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.341781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.341870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.356571] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 774.396295] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.396295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.396295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.396295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.396295] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.396295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.396647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.396647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.396647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.396753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.397291] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.397291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.397291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.397291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.397291] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.399506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.399506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.399506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.399506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.399506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.399506] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.833275] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.833275] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 152f9fdc-a191-41d0-b581-229bf76cbd95 not found, creating... [ 774.833275] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.833275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.833784] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.833784] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.833784] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.835158] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.835410] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.836702] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 152f9fdc-a191-41d0-b581-229bf76cbd95 is going to be created. [ 774.860679] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.860679] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.860679] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.862235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.862235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.862235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.901921] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df948508-d1d6-4368-979c-297ed94dda9d: rpc.has_security_group_logging(os_id): False [ 774.923438] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.923585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.923659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.923876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.923969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.924179] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.924275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.924355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.924495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.924572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.924749] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.924843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.924907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.925061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.925139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.925333] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.925430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.925493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.925635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.925710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.925794] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be updated. [ 775.087160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.087160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.087433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.087892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.087892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.126059] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 775.204890] env[69274]: INFO networking_nsxv3.common.synchronization [None req-99e9ae60-76de-419f-8d12-50f920a0cf8a None None] Enqueued Resource ID: a351b53f-45c8-496e-aac7-19d351a9b9d2 with Priority: HIGHEST for action port [ 775.205515] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a351b53f-45c8-496e-aac7-19d351a9b9d2 with Priority: HIGHEST for action port [ 775.205842] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a351b53f-45c8-496e-aac7-19d351a9b9d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.205974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a351b53f-45c8-496e-aac7-19d351a9b9d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.211476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a351b53f-45c8-496e-aac7-19d351a9b9d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.211476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a351b53f-45c8-496e-aac7-19d351a9b9d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.211476] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a351b53f-45c8-496e-aac7-19d351a9b9d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.386379] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6c444ae-af25-4279-9215-0b11d2e72a27 in Status: SUCCESS [ 775.386793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.387245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.387507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.387706] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.387831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.387888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.388061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.388142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.388228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.388319] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.713394] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a351b53f-45c8-496e-aac7-19d351a9b9d2 [ 775.715202] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.715431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.715548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.715932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.716075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.716310] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a351b53f-45c8-496e-aac7-19d351a9b9d2 already deleted. [ 775.716440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a351b53f-45c8-496e-aac7-19d351a9b9d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.890976] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.907030] env[69274]: INFO networking_nsxv3.common.synchronization [req-1e1feee6-41c5-40ea-936f-4b915af7f88f req-d2cebd8e-73d2-4960-b43a-b49196d101e1 service nova] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_rules [ 775.907030] env[69274]: INFO networking_nsxv3.common.synchronization [req-1e1feee6-41c5-40ea-936f-4b915af7f88f req-d2cebd8e-73d2-4960-b43a-b49196d101e1 service nova] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 775.907030] env[69274]: INFO networking_nsxv3.common.synchronization [req-1e1feee6-41c5-40ea-936f-4b915af7f88f req-d2cebd8e-73d2-4960-b43a-b49196d101e1 service nova] Enqueued Resource ID: 152f9fdc-a191-41d0-b581-229bf76cbd95 with Priority: HIGHEST for action port [ 775.909218] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_rules [ 775.910307] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 775.911354] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152f9fdc-a191-41d0-b581-229bf76cbd95 with Priority: HIGHEST for action port [ 775.914143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.914143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.914143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.914143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.914143] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.916293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.916595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.917756] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-152f9fdc-a191-41d0-b581-229bf76cbd95 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.918091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.918257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.919105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.919291] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152f9fdc-a191-41d0-b581-229bf76cbd95',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.367554] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 776.367802] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 deletion is rescheduled due to dependency. [ 776.368815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.368815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.368815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.368815] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.368815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.368815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.369228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.369228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.369228] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.393110] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6c444ae-af25-4279-9215-0b11d2e72a27: rpc.has_security_group_logging(os_id): False [ 776.412175] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.412298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.412358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.412683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.412683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.412873] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.412999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.413260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.413260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.413434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.413434] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 is going to be created. [ 776.420762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.420901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.421147] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 152f9fdc-a191-41d0-b581-229bf76cbd95 with status ACTIVE [ 776.421262] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.421348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.421422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.421577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.421665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.421829] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.421927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.421983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.422143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.422221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.422397] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.422493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.422551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.423292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.423292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.423292] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 152f9fdc-a191-41d0-b581-229bf76cbd95 is going to be updated. [ 776.441759] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.441990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.441990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.442157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.442299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.442462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-152f9fdc-a191-41d0-b581-229bf76cbd95" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.487124] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.487318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.487366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.487547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.487727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.499069] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6c444ae-af25-4279-9215-0b11d2e72a27 in Status: IN_PROGRESS for 2s [ 776.528250] env[69274]: INFO networking_nsxv3.common.synchronization [req-ff9927e2-8ee3-4ba5-8c4a-5c2fbd2c222e req-5f39eef1-8394-4495-812c-43d3903109fa tempest-ServersWithSpecificFlavorTestJSON-7327972 tempest-ServersWithSpecificFlavorTestJSON-7327972-project-member] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 776.528801] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 776.529143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.529255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.529588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.529588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.529737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.529796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.529839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.529947] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.530043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.530143] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.871770] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.990575] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.990890] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.990953] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.991313] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.991601] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.991763] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.991907] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.993105] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.993105] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.993105] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.993241] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.993334] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.993509] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.993648] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.993758] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.993908] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.016980] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.016980] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.016980] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.016980] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-197" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.016980] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d12eadc1-8331-4e2f-b6d9-0588070d9d99 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.016980] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.016980] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.016980] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.016980] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d12eadc1-8331-4e2f-b6d9-0588070d9d99',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.035868] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.036045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.036135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.036368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.036468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.036696] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.036806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.036889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.037146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.037232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.037360] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be updated. [ 777.070737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.070737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.070737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.070737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.070737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.082469] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: IN_PROGRESS for 2s [ 777.143054] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 777.143326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.374841] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.521376] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.521769] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.522832] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.522832] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.522832] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.523075] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port d12eadc1-8331-4e2f-b6d9-0588070d9d99 not found, creating... [ 777.523505] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.523792] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.524082] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.524469] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.524736] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.525248] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.525477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.525655] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.525955] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.526177] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.526383] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d12eadc1-8331-4e2f-b6d9-0588070d9d99 is going to be created. [ 777.548402] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.551024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.551024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.551024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.551024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.551024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.877215] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.877728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.877728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.877728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.877901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.877932] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be updated. [ 777.907933] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.907933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.907933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.908167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.908314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.922465] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 778.512110] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6c444ae-af25-4279-9215-0b11d2e72a27 in Status: SUCCESS [ 778.512373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.554264] env[69274]: INFO networking_nsxv3.common.synchronization [req-ff9927e2-8ee3-4ba5-8c4a-5c2fbd2c222e req-41456545-3e96-417c-904e-4b8921422aa9 service nova] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 778.554539] env[69274]: INFO networking_nsxv3.common.synchronization [req-ff9927e2-8ee3-4ba5-8c4a-5c2fbd2c222e req-41456545-3e96-417c-904e-4b8921422aa9 service nova] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 778.554603] env[69274]: INFO networking_nsxv3.common.synchronization [req-ff9927e2-8ee3-4ba5-8c4a-5c2fbd2c222e req-41456545-3e96-417c-904e-4b8921422aa9 service nova] Enqueued Resource ID: d12eadc1-8331-4e2f-b6d9-0588070d9d99 with Priority: HIGHEST for action port [ 778.554831] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_rules [ 778.554965] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 778.555089] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d12eadc1-8331-4e2f-b6d9-0588070d9d99 with Priority: HIGHEST for action port [ 778.555696] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.555807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.555905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.557948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.557948] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.557948] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.557948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.558137] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d12eadc1-8331-4e2f-b6d9-0588070d9d99 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.558249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.558364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.558575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.558673] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d12eadc1-8331-4e2f-b6d9-0588070d9d99',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.060969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.062164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.064223] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d12eadc1-8331-4e2f-b6d9-0588070d9d99 with status ACTIVE [ 779.064223] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.064223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.064223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.064223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.064454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.064714] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.064714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.064714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.064885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.064885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.065333] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.065333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.065333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.065333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.065584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.065584] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d12eadc1-8331-4e2f-b6d9-0588070d9d99 is going to be updated. [ 779.089173] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.089336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.089406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.089720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.089933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.090239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d12eadc1-8331-4e2f-b6d9-0588070d9d99" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.094247] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 779.094426] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a deletion is rescheduled due to dependency. [ 779.094537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.094696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.094904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.095111] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.095252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.095322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.095482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.095566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.095665] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.601638] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.937411] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 779.937411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.937665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.937742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.937943] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.938093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.938154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.939060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.939060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.939060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.939060] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.107370] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.352019] env[69274]: INFO networking_nsxv3.common.synchronization [req-224ea161-68b0-4c60-aa8b-8e089c4fde66 req-656693a8-1158-4b34-8ad8-1a3bb10f9379 tempest-ServerTagsTestJSON-2048526977 tempest-ServerTagsTestJSON-2048526977-project-member] Enqueued Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_members [ 780.352019] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_members [ 780.352503] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.352839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.353465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.353856] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.354187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.354487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.354963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.357020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.357020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.357020] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.443556] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.443725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.443800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.444060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.444238] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.444365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.444436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.444607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.444713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.444807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.444996] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.445131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.445195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.445345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.445491] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.445590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.445664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.446190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.446190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.446190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.446190] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.612693] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.612693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.612693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.612693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.612693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.612693] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be updated. [ 780.647662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.647662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.647662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.647662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.647662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.656274] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: IN_PROGRESS for 2s [ 780.858537] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.859554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.859554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.859554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.859554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.859833] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.859898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.859949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.860147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.860256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.860372] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b31396-6061-4e77-9c4c-98a255b434be already deleted. [ 780.861060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.950933] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 093f0a21-7741-4a8f-8410-d5b196f0f7d7: rpc.has_security_group_logging(os_id): False [ 780.976866] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.977092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.977188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.977441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.977576] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.977832] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.977970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.978088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.978301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.978391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.978587] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.978688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.978752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.978901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.978984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.980510] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.980650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.980690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.980857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.980940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.981063] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be updated. [ 781.058019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.058264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.058385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.058687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.061557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.074084] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 781.207563] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.207563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-620" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.207563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-620" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.207563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-620" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.207563] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.207563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.207563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.208096] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.208096] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.208386] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.208513] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.208643] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.209213] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.209460] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.209654] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.209933] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.239228] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.239228] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 781.239228] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.239228] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-620" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.239536] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.239733] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.239865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.240219] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.240361] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c53ee4-0ca2-4d2e-9973-32c51de036e7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.744531] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.744531] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.744531] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.745019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.745019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.745019] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port c1c53ee4-0ca2-4d2e-9973-32c51de036e7 not found, creating... [ 781.745172] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.746144] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.746144] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.746144] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.746144] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.746313] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.746387] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.746492] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.746721] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.746850] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.746988] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: c1c53ee4-0ca2-4d2e-9973-32c51de036e7 is going to be created. [ 781.772447] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.772688] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.772819] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.773126] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.773379] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.773633] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.839596] env[69274]: INFO networking_nsxv3.common.synchronization [req-bb4ef857-11f0-4956-ad6c-3a969096e10e req-6df752dd-9989-4b76-9554-ebb220b2104d tempest-ServersNegativeTestJSON-1840850554 tempest-ServersNegativeTestJSON-1840850554-project-member] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 781.840973] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 781.840973] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.840973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.843788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.843788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.843788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.843788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.843788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.843788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.843788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.843788] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.348559] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.670074] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 782.670590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.672268] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.672507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.672716] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.672841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.673011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.673103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.673192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.673283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.673381] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.836107] env[69274]: INFO networking_nsxv3.common.synchronization [req-224ea161-68b0-4c60-aa8b-8e089c4fde66 req-5a6a2ac1-d383-449d-a842-08344aaf2954 service nova] Enqueued Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_rules [ 782.836349] env[69274]: INFO networking_nsxv3.common.synchronization [req-224ea161-68b0-4c60-aa8b-8e089c4fde66 req-5a6a2ac1-d383-449d-a842-08344aaf2954 service nova] Enqueued Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_members [ 782.836429] env[69274]: INFO networking_nsxv3.common.synchronization [req-224ea161-68b0-4c60-aa8b-8e089c4fde66 req-5a6a2ac1-d383-449d-a842-08344aaf2954 service nova] Enqueued Resource ID: c1c53ee4-0ca2-4d2e-9973-32c51de036e7 with Priority: HIGHEST for action port [ 782.836671] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_rules [ 782.836831] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_members [ 782.836955] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c53ee4-0ca2-4d2e-9973-32c51de036e7 with Priority: HIGHEST for action port [ 782.840218] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.840361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.840426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.840740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.840783] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.841738] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.841892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.841929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.845952] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.845952] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.845952] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.845952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.845952] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c53ee4-0ca2-4d2e-9973-32c51de036e7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.851815] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.092160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 783.092160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.175878] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.345256] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.347110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.347344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.349292] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1c53ee4-0ca2-4d2e-9973-32c51de036e7 with status ACTIVE [ 783.349292] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.349432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.349483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.349792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.349914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.350186] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.351146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.351146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.351146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.351146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.351146] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.351146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.351146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.351797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.351797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.351797] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1c53ee4-0ca2-4d2e-9973-32c51de036e7 is going to be updated. [ 783.354241] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.354416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.354416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.355173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.355173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.355173] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be updated. [ 783.388270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.388543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.388543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.388712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.388871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.389064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c53ee4-0ca2-4d2e-9973-32c51de036e7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.397259] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.397478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.397551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.397859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.398044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.408073] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 783.679688] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a: rpc.has_security_group_logging(os_id): False [ 783.699907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.699907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.699907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.699907] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be updated. [ 783.768160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.768389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.768475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.768713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.768913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.788696] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: IN_PROGRESS for 2s [ 783.849725] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.076941] env[69274]: INFO networking_nsxv3.common.synchronization [None req-60fd729c-e268-4d15-95be-fac4f1d87ce9 None None] Enqueued Resource ID: 51e97743-4695-4a95-a8d1-0e912f5c1fc0 with Priority: HIGHEST for action port [ 784.077218] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51e97743-4695-4a95-a8d1-0e912f5c1fc0 with Priority: HIGHEST for action port [ 784.078106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-51e97743-4695-4a95-a8d1-0e912f5c1fc0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.078252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51e97743-4695-4a95-a8d1-0e912f5c1fc0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.078321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51e97743-4695-4a95-a8d1-0e912f5c1fc0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.078583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51e97743-4695-4a95-a8d1-0e912f5c1fc0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.078665] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51e97743-4695-4a95-a8d1-0e912f5c1fc0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.356052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.356357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.356440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.356698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.356812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.356917] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b31396-6061-4e77-9c4c-98a255b434be is going to be created. [ 784.383384] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.383566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.383693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.383978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.384097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.398225] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b31396-6061-4e77-9c4c-98a255b434be in Status: UNINITIALIZED for 2s [ 784.581320] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51e97743-4695-4a95-a8d1-0e912f5c1fc0 [ 784.582948] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.582948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.582948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.582948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.582948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.582948] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51e97743-4695-4a95-a8d1-0e912f5c1fc0 already deleted. [ 784.582948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51e97743-4695-4a95-a8d1-0e912f5c1fc0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.420568] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 785.420568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.805196] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 785.805196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.003363] env[69274]: INFO networking_nsxv3.common.synchronization [req-729aae6c-cdb2-4d7f-92c5-fb7a5f515fea req-f529e1dd-b5e7-48b4-b9a4-08119d09cbc0 tempest-ListImageFiltersTestJSON-1188695543 tempest-ListImageFiltersTestJSON-1188695543-project-member] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 786.004125] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGHEST for action security_group_members [ 786.004540] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.004691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.004766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.005018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.005227] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.005370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.005483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.005671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.005830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.005953] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.409161] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b31396-6061-4e77-9c4c-98a255b434be in Status: SUCCESS [ 786.410335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.410335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.410335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.410335] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.410335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.410335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.413814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.413990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.415520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.415520] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.511836] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.511836] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.514389] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be updated. [ 786.545078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.545225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.545297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.545511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.545682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.555898] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: IN_PROGRESS for 2s [ 786.653964] env[69274]: INFO networking_nsxv3.common.synchronization [None req-c5b9ac06-6ab0-419b-9a07-985673880cde None None] Enqueued Resource ID: e1f49068-91d2-422d-b676-696cc38032aa with Priority: HIGHEST for action port [ 786.654257] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f49068-91d2-422d-b676-696cc38032aa with Priority: HIGHEST for action port [ 786.654830] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1f49068-91d2-422d-b676-696cc38032aa taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.654972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1f49068-91d2-422d-b676-696cc38032aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.655058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1f49068-91d2-422d-b676-696cc38032aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.655353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1f49068-91d2-422d-b676-696cc38032aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.655438] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1f49068-91d2-422d-b676-696cc38032aa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.703951] env[69274]: INFO networking_nsxv3.common.synchronization [req-cf788e4a-2f5e-4d96-88df-a7d5bce30cc1 req-43197849-5ca2-4bab-bea9-d67347574802 tempest-SecurityGroupRulesNegativeTestJSON-886632216 tempest-SecurityGroupRulesNegativeTestJSON-886632216-project-member] Enqueued Resource ID: ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d with Priority: HIGHEST for action security_group_rules [ 786.704496] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d with Priority: HIGHEST for action security_group_rules [ 786.704805] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.705085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.705085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.705246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.705401] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.869301] env[69274]: INFO networking_nsxv3.common.synchronization [None req-27fc671f-201a-4f4a-9949-9835ada402e6 None None] Enqueued Resource ID: 5e7462e8-4706-43ee-b62c-bf01b23b2588 with Priority: HIGHEST for action port [ 786.869976] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e7462e8-4706-43ee-b62c-bf01b23b2588 with Priority: HIGHEST for action port [ 786.870312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e7462e8-4706-43ee-b62c-bf01b23b2588 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.873606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e7462e8-4706-43ee-b62c-bf01b23b2588" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.873606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e7462e8-4706-43ee-b62c-bf01b23b2588" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.873606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e7462e8-4706-43ee-b62c-bf01b23b2588" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.873606] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e7462e8-4706-43ee-b62c-bf01b23b2588',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.917591] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.920799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.920898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.921247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.921475] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.921643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.921726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.922130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.922255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.922504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.922677] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.922779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.922868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.922987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.923158] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.923245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.923335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.923442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.923521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.923633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.923688] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.159055] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1f49068-91d2-422d-b676-696cc38032aa [ 787.159403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.159481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.159523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.160024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.160024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.160024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1f49068-91d2-422d-b676-696cc38032aa already deleted. [ 787.160223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1f49068-91d2-422d-b676-696cc38032aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.241678] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.241678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.241678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.241678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.241678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.241678] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d already deleted. [ 787.241678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.375882] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e7462e8-4706-43ee-b62c-bf01b23b2588 [ 787.376029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.376214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.376214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.376822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.376822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.376822] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e7462e8-4706-43ee-b62c-bf01b23b2588 already deleted. [ 787.376822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e7462e8-4706-43ee-b62c-bf01b23b2588" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.420514] env[69274]: INFO networking_nsxv3.common.synchronization [req-430ce7e4-2cbc-44ff-b1dc-bceec8db7efb req-5d6b6f8e-13c2-408e-adea-241f0f65d786 tempest-SecurityGroupRulesNegativeTestJSON-886632216 tempest-SecurityGroupRulesNegativeTestJSON-886632216-project-member] Enqueued Resource ID: ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d with Priority: HIGHEST for action security_group_rules [ 787.421388] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d with Priority: HIGHEST for action security_group_rules [ 787.421708] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.421708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.421708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.422907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.422907] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.428971] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63b31396-6061-4e77-9c4c-98a255b434be: rpc.has_security_group_logging(os_id): False [ 787.451152] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.451152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.451152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.451496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.451496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.452258] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.452258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.452258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.452258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.452258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.452530] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.452530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.452621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.453130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.453130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.453130] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.453130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.454094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.454094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.454094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.454094] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b31396-6061-4e77-9c4c-98a255b434be is going to be created. [ 787.536160] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.536525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.536525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.536640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.536838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.551161] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b31396-6061-4e77-9c4c-98a255b434be in Status: IN_PROGRESS for 2s [ 787.949018] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.949018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.949018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.949018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.949018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.949018] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d already deleted. [ 787.949018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed7ce6f4-f75e-4d1a-aa88-7735dca1f25d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.147198] env[69274]: INFO networking_nsxv3.common.synchronization [req-25395e30-9ef7-4f16-9b45-2abc762da89c req-d5f2e725-bb18-4fdb-8722-0cec50801524 tempest-VolumesAdminNegativeTest-289876529 tempest-VolumesAdminNegativeTest-289876529-project-member] Enqueued Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_members [ 788.148372] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_members [ 788.148700] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.148831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.148893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.149625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.150486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.150486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.150486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.150486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.150486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.150486] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.569814] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 in Status: SUCCESS [ 788.570127] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 deletion is rescheduled due to dependency. [ 788.570600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.652499] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.652743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.652876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.653214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.653287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.653536] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.653699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.653798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.653994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.654135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.654271] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c already deleted. [ 788.654462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.769277] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.769980] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.770128] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.770563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.771486] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.771900] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.772018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.772551] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.773182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.773497] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.773763] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.773935] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.774093] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.774447] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 788.774671] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.774841] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.798987] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.799163] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 788.799667] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.799885] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-567" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.800257] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-747d985d-fdc1-486d-b814-0ffdb2482537 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.800437] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.800557] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.800897] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.801033] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('747d985d-fdc1-486d-b814-0ffdb2482537',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.303444] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.303650] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.305788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.305788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.305788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.305788] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 747d985d-fdc1-486d-b814-0ffdb2482537 not found, creating... [ 789.305788] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.305788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.305788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.305788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.305788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.307185] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.307536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.307661] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.307892] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.308835] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.309037] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 747d985d-fdc1-486d-b814-0ffdb2482537 is going to be created. [ 789.331517] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.331759] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.331861] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.332157] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.332391] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.332706] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.565192] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b31396-6061-4e77-9c4c-98a255b434be in Status: SUCCESS [ 789.565433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.049145] env[69274]: INFO networking_nsxv3.common.synchronization [None req-4cc10ab6-2ff3-4f97-baea-4f8dea4ceed5 None None] Enqueued Resource ID: 28e039ac-98e9-47a9-866c-259af3ec1ef8 with Priority: HIGHEST for action port [ 790.049145] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e039ac-98e9-47a9-866c-259af3ec1ef8 with Priority: HIGHEST for action port [ 790.049145] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-28e039ac-98e9-47a9-866c-259af3ec1ef8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.049145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28e039ac-98e9-47a9-866c-259af3ec1ef8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.049145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28e039ac-98e9-47a9-866c-259af3ec1ef8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.049145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28e039ac-98e9-47a9-866c-259af3ec1ef8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.049145] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28e039ac-98e9-47a9-866c-259af3ec1ef8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.201402] env[69274]: INFO networking_nsxv3.common.synchronization [req-25395e30-9ef7-4f16-9b45-2abc762da89c req-ff63b1e9-459a-450c-8918-0d763c77052c service nova] Enqueued Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_rules [ 790.201402] env[69274]: INFO networking_nsxv3.common.synchronization [req-25395e30-9ef7-4f16-9b45-2abc762da89c req-ff63b1e9-459a-450c-8918-0d763c77052c service nova] Enqueued Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_members [ 790.201402] env[69274]: INFO networking_nsxv3.common.synchronization [req-25395e30-9ef7-4f16-9b45-2abc762da89c req-ff63b1e9-459a-450c-8918-0d763c77052c service nova] Enqueued Resource ID: 747d985d-fdc1-486d-b814-0ffdb2482537 with Priority: HIGHEST for action port [ 790.201402] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_rules [ 790.201402] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_members [ 790.202104] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747d985d-fdc1-486d-b814-0ffdb2482537 with Priority: HIGHEST for action port [ 790.202898] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.206024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.206024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.206024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.206024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.206024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.206961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-747d985d-fdc1-486d-b814-0ffdb2482537 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.207271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.207469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.207729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.207930] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('747d985d-fdc1-486d-b814-0ffdb2482537',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.553505] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28e039ac-98e9-47a9-866c-259af3ec1ef8 [ 790.553505] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.553505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.553505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.553505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.553505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.553505] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28e039ac-98e9-47a9-866c-259af3ec1ef8 already deleted. [ 790.553505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28e039ac-98e9-47a9-866c-259af3ec1ef8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.711010] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.715192] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.715192] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 747d985d-fdc1-486d-b814-0ffdb2482537 with status ACTIVE [ 790.715192] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.715192] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.715192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.718320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.718320] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.718320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.718320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.718320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.718320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.718320] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 747d985d-fdc1-486d-b814-0ffdb2482537 is going to be updated. [ 790.754789] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.755016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.755097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.756038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.756038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.756038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-747d985d-fdc1-486d-b814-0ffdb2482537" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.828439] env[69274]: INFO networking_nsxv3.common.synchronization [req-8d532900-c444-487b-b1a0-26168eb521b6 req-cffbed0c-7d56-486c-b22a-acc2da3d54d2 tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 790.829864] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 790.830310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.830437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.830549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.830764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.830920] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.831035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.831095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.831944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.831944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.831944] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.219904] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.336524] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.474250] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-355 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.477359] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.477510] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.477814] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.478118] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.478302] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.478411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.478639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.478785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.479009] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.479135] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.479250] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.479897] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.479897] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.479897] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.479897] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.500208] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.500409] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.500522] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.500738] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-355" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.501139] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-94d2b023-3f46-404b-abb5-df33d2dbdae8 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.501305] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.501558] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.501790] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.502354] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d2b023-3f46-404b-abb5-df33d2dbdae8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.723382] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.723572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.723650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.723880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.723976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.724093] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c is going to be created. [ 791.755668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.755817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.755888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.756371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.756602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.769877] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c in Status: UNINITIALIZED for 2s [ 791.839451] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.004609] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.004863] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.004971] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.005332] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.005536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.005657] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 94d2b023-3f46-404b-abb5-df33d2dbdae8 not found, creating... [ 792.005922] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.006159] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.006218] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.006440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.006587] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.006909] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.007046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.007140] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.007353] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.007490] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.007633] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 94d2b023-3f46-404b-abb5-df33d2dbdae8 is going to be created. [ 792.036603] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.036603] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.036603] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.036603] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.036603] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.036603] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.342898] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.343209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.343209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.343420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.343535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.343693] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 792.379261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.379439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.379516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.380092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.380092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.391205] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 792.822314] env[69274]: INFO networking_nsxv3.common.synchronization [req-8d532900-c444-487b-b1a0-26168eb521b6 req-3ce72796-1b70-4318-96ce-b7374c1a01b6 service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 792.822314] env[69274]: INFO networking_nsxv3.common.synchronization [req-8d532900-c444-487b-b1a0-26168eb521b6 req-3ce72796-1b70-4318-96ce-b7374c1a01b6 service nova] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 792.822314] env[69274]: INFO networking_nsxv3.common.synchronization [req-8d532900-c444-487b-b1a0-26168eb521b6 req-3ce72796-1b70-4318-96ce-b7374c1a01b6 service nova] Enqueued Resource ID: 94d2b023-3f46-404b-abb5-df33d2dbdae8 with Priority: HIGHEST for action port [ 792.822314] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_rules [ 792.822314] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 792.822314] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d2b023-3f46-404b-abb5-df33d2dbdae8 with Priority: HIGHEST for action port [ 792.822314] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.822314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.822314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.823098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.823389] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.825300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.827052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.827052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-94d2b023-3f46-404b-abb5-df33d2dbdae8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.827052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.827052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.827052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.827052] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d2b023-3f46-404b-abb5-df33d2dbdae8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.329046] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94d2b023-3f46-404b-abb5-df33d2dbdae8 with status ACTIVE [ 793.329366] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.329546] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.329636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.330207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.330207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.330207] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.330787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.330787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.330787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.330787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.331361] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.331361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.331361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.331914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.331914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.331914] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94d2b023-3f46-404b-abb5-df33d2dbdae8 is going to be updated. [ 793.333113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.333311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.360281] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.360631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.360631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.360797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.360943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.361154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94d2b023-3f46-404b-abb5-df33d2dbdae8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.780081] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c in Status: SUCCESS [ 793.780510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.780510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.780724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.780918] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.781228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.781228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.781300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.781334] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.781429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.781555] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.286212] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.286377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.286441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.286668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.286881] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.287077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.287148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.287283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.287370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.287460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.287733] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.287835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.287897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.288061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.288206] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.288298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.288358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.288500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.288578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.288658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.288745] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.401321] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 794.401629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.401887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.402088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.402277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.402399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.402467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.402631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.402750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.402850] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.792945] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e746a7b-3bcb-4275-9eab-0b5a5360426c: rpc.has_security_group_logging(os_id): False [ 794.822221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.822846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.822846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.822846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.823032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.823142] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.823253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.823320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.823487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.823664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.823760] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.823854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.823915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.824074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.824305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.824366] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.824433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.824487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.824626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.824701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.824789] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c is going to be created. [ 794.910817] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.911068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.911068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.911281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.911637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.913399] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.921126] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c in Status: IN_PROGRESS for 2s [ 795.416063] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.922039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.922039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.922039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.922039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.922039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.922039] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 795.956367] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.957073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.957073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.957073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.957073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.976289] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 795.999251] env[69274]: INFO networking_nsxv3.common.synchronization [req-e59bf6c9-5102-4652-b240-5e9cf6d1ae8a req-13cf6338-e164-44e2-8cf5-01db40c9f97d tempest-ServersNegativeTestMultiTenantJSON-121196380 tempest-ServersNegativeTestMultiTenantJSON-121196380-project-member] Enqueued Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_members [ 795.999251] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_members [ 795.999251] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.000249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.000368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.000610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.000795] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.000904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.000970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.001141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.001278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.002139] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.505294] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.505633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.505633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.506608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.506768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.507078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.507239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.507351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.507597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.507790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.507864] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efef42a0-7879-4e5e-b07d-896b827035c2 already deleted. [ 796.507960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.563629] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.563902] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.564052] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.564389] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.564671] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.564837] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.564957] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.565560] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.565748] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.565980] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.566110] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.566220] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.566327] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.566623] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.566623] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.566769] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.590219] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.590334] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.590531] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.591051] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.591142] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-6d6fdccc-6769-41a8-91b9-79df827dbddd taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.591264] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.591370] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.592455] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.592455] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d6fdccc-6769-41a8-91b9-79df827dbddd',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.934407] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c in Status: SUCCESS [ 796.935213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.098281] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.098281] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.098281] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.098281] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.099508] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.099508] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 6d6fdccc-6769-41a8-91b9-79df827dbddd not found, creating... [ 797.099508] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.099852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.099852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.099922] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.100074] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.104691] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.104691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.104691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.104691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.104691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.104691] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 6d6fdccc-6769-41a8-91b9-79df827dbddd is going to be created. [ 797.128082] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.128495] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.129023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.129612] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.129902] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.130246] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.404501] env[69274]: INFO networking_nsxv3.common.synchronization [req-3bb1d29f-f547-45c9-ab34-3ae919bb6fe5 req-73e6da8f-c738-4af2-b648-bb6560e64204 tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 797.405251] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 797.405504] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.405633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.405701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.405964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.406231] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.406368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.406454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.406858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.406960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.407083] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.445896] env[69274]: INFO networking_nsxv3.common.synchronization [req-e5cd4522-7785-40a0-abf0-d4fe721e2138 req-d1e1eae0-36e9-4dbb-8c9a-8fe87eb7fd95 tempest-ServerTagsTestJSON-2048526977 tempest-ServerTagsTestJSON-2048526977-project-member] Enqueued Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_members [ 797.448094] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGHEST for action security_group_members [ 797.448094] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.448094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.448094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.448094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.448094] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.448094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.448094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.448094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.448094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.448094] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.909689] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.910087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.910087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.910221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.910259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.910663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.910830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.910920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.911129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.911221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.911338] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be updated. [ 797.949471] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.949471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.949471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.949471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.949471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.955292] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.955512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.955564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.955830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.955983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.956301] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.956445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.956547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.956801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.956934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.957108] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b31396-6061-4e77-9c4c-98a255b434be is going to be updated. [ 797.974820] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 797.985168] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 797.985504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.985745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.986060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.987350] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.987350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.987350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.987350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.987350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.987350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.987350] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.002758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.002992] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.003053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.003361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.003600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.020546] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b31396-6061-4e77-9c4c-98a255b434be in Status: IN_PROGRESS for 2s [ 798.224135] env[69274]: INFO networking_nsxv3.common.synchronization [req-e59bf6c9-5102-4652-b240-5e9cf6d1ae8a req-f6785299-189a-465e-aa79-dfc8593151e9 service nova] Enqueued Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_rules [ 798.224135] env[69274]: INFO networking_nsxv3.common.synchronization [req-e59bf6c9-5102-4652-b240-5e9cf6d1ae8a req-f6785299-189a-465e-aa79-dfc8593151e9 service nova] Enqueued Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_members [ 798.224135] env[69274]: INFO networking_nsxv3.common.synchronization [req-e59bf6c9-5102-4652-b240-5e9cf6d1ae8a req-f6785299-189a-465e-aa79-dfc8593151e9 service nova] Enqueued Resource ID: 6d6fdccc-6769-41a8-91b9-79df827dbddd with Priority: HIGHEST for action port [ 798.225254] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_rules [ 798.225492] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_members [ 798.225585] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d6fdccc-6769-41a8-91b9-79df827dbddd with Priority: HIGHEST for action port [ 798.227230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.227230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.227230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.227230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.227230] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.228383] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.228574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.229456] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.229707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.229884] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.230011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.230076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.230275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.230314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.230419] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.232838] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d6fdccc-6769-41a8-91b9-79df827dbddd taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.232838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.232838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.232838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.232838] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d6fdccc-6769-41a8-91b9-79df827dbddd',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.490413] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.492020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.492020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.492020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.492020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.492020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.492020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.492724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.492724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.492724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.492724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.492937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.492994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.494251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.494251] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.494251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.494389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.494648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.494648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.494799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.494799] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.728819] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.729256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.732842] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.735644] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d6fdccc-6769-41a8-91b9-79df827dbddd with status ACTIVE [ 798.736974] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.740133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.740133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.740133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.740133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.740324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.740971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.740971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.740971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.740971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.740971] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.741208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.741208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.741289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.741289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.741372] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d6fdccc-6769-41a8-91b9-79df827dbddd is going to be updated. [ 798.767107] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.767238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.767303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.767504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.767650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.767816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d6fdccc-6769-41a8-91b9-79df827dbddd" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.997344] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f: rpc.has_security_group_logging(os_id): False [ 799.019395] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.019613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.019674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.019878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.019972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.020275] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.020275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.020395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.020640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.020640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.020798] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.020900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.020963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.021846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.021846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.022162] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.022323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.022436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.022663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.022793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.022938] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 799.085231] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.085961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.085961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.085961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.085961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.104360] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 799.236160] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.325265] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3476e20b-3439-4bbc-af7b-737a699cdfcd None None] Enqueued Resource ID: 6ecbeea7-650a-4d91-9cb0-2fa6949fecc8 with Priority: HIGHEST for action port [ 799.325265] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ecbeea7-650a-4d91-9cb0-2fa6949fecc8 with Priority: HIGHEST for action port [ 799.325900] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ecbeea7-650a-4d91-9cb0-2fa6949fecc8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.326337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ecbeea7-650a-4d91-9cb0-2fa6949fecc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.326563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ecbeea7-650a-4d91-9cb0-2fa6949fecc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.326983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ecbeea7-650a-4d91-9cb0-2fa6949fecc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.327207] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ecbeea7-650a-4d91-9cb0-2fa6949fecc8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.739997] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.740185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.740263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.740476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.740571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.740672] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efef42a0-7879-4e5e-b07d-896b827035c2 is going to be created. [ 799.769271] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.769271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.769271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.769271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.769271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.781047] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efef42a0-7879-4e5e-b07d-896b827035c2 in Status: UNINITIALIZED for 2s [ 799.829457] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ecbeea7-650a-4d91-9cb0-2fa6949fecc8 [ 799.830140] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.830140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.830140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.830394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.830394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.830394] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ecbeea7-650a-4d91-9cb0-2fa6949fecc8 already deleted. [ 799.830496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ecbeea7-650a-4d91-9cb0-2fa6949fecc8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.985978] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 799.986229] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 deletion is rescheduled due to dependency. [ 799.986410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.034293] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b31396-6061-4e77-9c4c-98a255b434be in Status: SUCCESS [ 800.034293] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b31396-6061-4e77-9c4c-98a255b434be deletion is rescheduled due to dependency. [ 800.034293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.207943] env[69274]: INFO networking_nsxv3.common.synchronization [req-5fe0155b-87f2-4af6-b82e-f3ca543dd215 req-e73f604f-1b61-4af7-acd9-a220c87b2b92 tempest-ServersAdminNegativeTestJSON-1537378782 tempest-ServersAdminNegativeTestJSON-1537378782-project-member] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 800.208457] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGHEST for action security_group_members [ 800.208870] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.211317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.212542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.212542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.212542] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.212542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.212542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.212903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.212903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.212969] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.716201] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.716372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.716372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.717903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.717903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.717903] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.717903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.717903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.717903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.717903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.717903] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be updated. [ 800.748833] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.749015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.749080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.749269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.749409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.759188] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: IN_PROGRESS for 2s [ 801.133646] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 801.133646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.585378] env[69274]: INFO networking_nsxv3.common.synchronization [None req-5735ed34-ab4b-40d2-9830-7fd3edf7c281 None None] Enqueued Resource ID: b71548a2-f18a-4603-9b8c-b216bbe7ed75 with Priority: HIGHEST for action port [ 801.585378] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b71548a2-f18a-4603-9b8c-b216bbe7ed75 with Priority: HIGHEST for action port [ 801.585963] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b71548a2-f18a-4603-9b8c-b216bbe7ed75 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.586124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b71548a2-f18a-4603-9b8c-b216bbe7ed75" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.586196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b71548a2-f18a-4603-9b8c-b216bbe7ed75" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.586419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b71548a2-f18a-4603-9b8c-b216bbe7ed75" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.586496] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b71548a2-f18a-4603-9b8c-b216bbe7ed75',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.795240] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efef42a0-7879-4e5e-b07d-896b827035c2 in Status: SUCCESS [ 801.795240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.795998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.796267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.796608] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.796608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.796834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.796834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.796957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.797022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.797113] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.090958] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b71548a2-f18a-4603-9b8c-b216bbe7ed75 [ 802.090958] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.090958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.090958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.090958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.090958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.090958] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b71548a2-f18a-4603-9b8c-b216bbe7ed75 already deleted. [ 802.090958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b71548a2-f18a-4603-9b8c-b216bbe7ed75" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.300494] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.300832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.300832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.300975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.301909] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.301909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.301909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.301909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.301909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.302541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.302761] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.303082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.303082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.303082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.303227] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.306033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.306033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.306033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.306033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.306033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.306033] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.783318] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59b1a355-727a-429c-8793-e86ce70f75b8 in Status: SUCCESS [ 802.783510] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 deletion is rescheduled due to dependency. [ 802.783629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.808268] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efef42a0-7879-4e5e-b07d-896b827035c2: rpc.has_security_group_logging(os_id): False [ 802.830588] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.830754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.830826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.831069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.831160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.831395] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.831566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.831653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.831820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.831958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.832116] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.832211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.832271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.832408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.832481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.832704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.832838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.832885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.832993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.833077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.833161] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efef42a0-7879-4e5e-b07d-896b827035c2 is going to be created. [ 802.893938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.894082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.894126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.894359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.894580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.909625] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efef42a0-7879-4e5e-b07d-896b827035c2 in Status: IN_PROGRESS for 2s [ 804.923815] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efef42a0-7879-4e5e-b07d-896b827035c2 in Status: SUCCESS [ 804.924794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.587833] env[69274]: INFO networking_nsxv3.common.synchronization [req-c0e96c75-e894-4fb3-9a23-c88974b5b078 req-486b3c80-5040-461c-bb60-bd361d9406fb tempest-VolumesAdminNegativeTest-289876529 tempest-VolumesAdminNegativeTest-289876529-project-member] Enqueued Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_members [ 805.588546] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGHEST for action security_group_members [ 805.588865] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.588988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.590777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.591067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.591343] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.591439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.591593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.591707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.591795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.591905] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.901854] env[69274]: INFO networking_nsxv3.common.synchronization [None req-f856888e-e634-414e-8c55-02efde0952a6 None None] Enqueued Resource ID: 50b5c8a8-7816-4a75-9a8d-e93d5726f7a9 with Priority: HIGHEST for action port [ 805.902949] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b5c8a8-7816-4a75-9a8d-e93d5726f7a9 with Priority: HIGHEST for action port [ 805.903305] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b5c8a8-7816-4a75-9a8d-e93d5726f7a9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.903430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b5c8a8-7816-4a75-9a8d-e93d5726f7a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.903527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b5c8a8-7816-4a75-9a8d-e93d5726f7a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.903756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b5c8a8-7816-4a75-9a8d-e93d5726f7a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.904306] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b5c8a8-7816-4a75-9a8d-e93d5726f7a9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.096204] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.096503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.096503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.096750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.096750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.096928] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.097042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.097108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.097262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.097338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.097422] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c is going to be updated. [ 806.130308] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.133922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.134066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.134430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.134736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.149496] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c in Status: IN_PROGRESS for 2s [ 806.405871] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50b5c8a8-7816-4a75-9a8d-e93d5726f7a9 [ 806.405871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.405871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.406133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.406845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.406845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.406845] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50b5c8a8-7816-4a75-9a8d-e93d5726f7a9 already deleted. [ 806.406845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b5c8a8-7816-4a75-9a8d-e93d5726f7a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.798702] env[69274]: INFO networking_nsxv3.common.synchronization [None req-03230158-3c30-49be-ad79-d4426c91931a tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_rules [ 806.798702] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_rules [ 806.798879] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.798879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.798986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.799258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.799347] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.872328] env[69274]: INFO networking_nsxv3.common.synchronization [req-21975beb-b2f7-46a8-8b2c-0c7f74881fdd req-3cd0d099-f6c7-4a54-a6e1-4342d11cfbd6 tempest-ServersTestJSON-1296568971 tempest-ServersTestJSON-1296568971-project-member] Enqueued Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_members [ 806.873057] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_members [ 806.873244] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.873375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.873451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.873702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.874060] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.874060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.874060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.878255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.878255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.878255] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.905297] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7bd90eda-d13d-45b6-9f92-a6c0a68f296c tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_rules [ 806.906259] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_rules [ 806.909428] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.909428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.321859] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.322189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.322189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.323138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.323241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.323339] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d already deleted. [ 807.323423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.323586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.323753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.323837] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.380104] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.380264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.380334] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.380549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.380640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.380826] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.380918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.380977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.381135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.381207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.381286] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 already deleted. [ 807.381362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.592131] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.592424] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-294" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.592602] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-294" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.593057] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-294" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.593440] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.593668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.593838] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.594156] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.594364] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.594701] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.594841] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.594958] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.595082] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.595198] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.595305] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.595437] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.618501] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.618501] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.618501] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.618733] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-294" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.618953] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-2e743ea5-9d4c-4834-84de-7bb11ba40f41 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.619166] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.621097] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.621097] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.621097] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e743ea5-9d4c-4834-84de-7bb11ba40f41',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.850132] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.850132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.850251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.850502] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.850629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.850755] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d already deleted. [ 807.850878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.126202] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.126202] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.126202] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.126202] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.126202] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.126202] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 2e743ea5-9d4c-4834-84de-7bb11ba40f41 not found, creating... [ 808.126717] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.126809] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.127871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.127871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.127871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.127871] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.128131] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.128249] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.129336] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.129526] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.129716] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 2e743ea5-9d4c-4834-84de-7bb11ba40f41 is going to be created. [ 808.151979] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.152167] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.154718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.154718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.154718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.154718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.169652] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c in Status: SUCCESS [ 808.169652] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c deletion is rescheduled due to dependency. [ 808.169652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.170362] env[69274]: INFO networking_nsxv3.common.synchronization [None req-6a7e9f17-38a5-40ad-a174-c6cd8240d23f None None] Enqueued Resource ID: 29092d63-a1ca-4e5b-a36b-77c801ed1c13 with Priority: HIGHEST for action port [ 808.170467] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29092d63-a1ca-4e5b-a36b-77c801ed1c13 with Priority: HIGHEST for action port [ 808.170750] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-29092d63-a1ca-4e5b-a36b-77c801ed1c13 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.170890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29092d63-a1ca-4e5b-a36b-77c801ed1c13" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.170890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29092d63-a1ca-4e5b-a36b-77c801ed1c13" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.171157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29092d63-a1ca-4e5b-a36b-77c801ed1c13" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.171270] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29092d63-a1ca-4e5b-a36b-77c801ed1c13',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.674866] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29092d63-a1ca-4e5b-a36b-77c801ed1c13 [ 808.675154] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.675424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.675424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.675656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.676104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.676104] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29092d63-a1ca-4e5b-a36b-77c801ed1c13 already deleted. [ 808.676836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29092d63-a1ca-4e5b-a36b-77c801ed1c13" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.981328] env[69274]: INFO networking_nsxv3.common.synchronization [req-e702d552-d2d9-4df2-9077-ce8ff1e28dec req-d14c48fd-8659-4eb5-ad72-1f7cd4db86cf tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 808.981744] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 808.982116] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.982192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.982264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.982416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.982570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.982725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.982817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.982971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.983090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.983157] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.988360] env[69274]: INFO networking_nsxv3.common.synchronization [req-21975beb-b2f7-46a8-8b2c-0c7f74881fdd req-d66704f0-00a0-42ab-a197-994853484273 service nova] Enqueued Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_rules [ 808.988360] env[69274]: INFO networking_nsxv3.common.synchronization [req-21975beb-b2f7-46a8-8b2c-0c7f74881fdd req-d66704f0-00a0-42ab-a197-994853484273 service nova] Enqueued Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_members [ 808.988360] env[69274]: INFO networking_nsxv3.common.synchronization [req-21975beb-b2f7-46a8-8b2c-0c7f74881fdd req-d66704f0-00a0-42ab-a197-994853484273 service nova] Enqueued Resource ID: 2e743ea5-9d4c-4834-84de-7bb11ba40f41 with Priority: HIGHEST for action port [ 808.988360] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_rules [ 808.988360] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_members [ 808.988360] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e743ea5-9d4c-4834-84de-7bb11ba40f41 with Priority: HIGHEST for action port [ 808.988360] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.988360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.988360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.988360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.988360] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.988360] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.988954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.988954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.988954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.988954] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.988954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.988954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.989209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.989209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.989209] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.989940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e743ea5-9d4c-4834-84de-7bb11ba40f41 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.990083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.990083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.991954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.991954] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e743ea5-9d4c-4834-84de-7bb11ba40f41',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.005738] env[69274]: INFO networking_nsxv3.common.synchronization [req-e702d552-d2d9-4df2-9077-ce8ff1e28dec req-d14c48fd-8659-4eb5-ad72-1f7cd4db86cf tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 809.006430] env[69274]: INFO networking_nsxv3.common.synchronization [req-e702d552-d2d9-4df2-9077-ce8ff1e28dec req-d14c48fd-8659-4eb5-ad72-1f7cd4db86cf tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 809.009920] env[69274]: INFO networking_nsxv3.common.synchronization [req-e702d552-d2d9-4df2-9077-ce8ff1e28dec req-d14c48fd-8659-4eb5-ad72-1f7cd4db86cf tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 725820e7-6c36-42a7-b348-480790c19a52 with Priority: HIGHEST for action port [ 809.009920] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 809.009920] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 809.009920] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725820e7-6c36-42a7-b348-480790c19a52 with Priority: HIGHEST for action port [ 809.009920] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.009920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.009920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.009920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.009920] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.010877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.011109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.011393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-725820e7-6c36-42a7-b348-480790c19a52 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.011743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.011895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.012182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.012352] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725820e7-6c36-42a7-b348-480790c19a52',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.486879] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.491803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.491959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.492143] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.492976] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e743ea5-9d4c-4834-84de-7bb11ba40f41 with status ACTIVE [ 809.493236] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.493303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.493343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.493609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.493661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.493860] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.493943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.493984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.494137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.494214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.494393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.494487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.494548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.494749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.494749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.494824] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e743ea5-9d4c-4834-84de-7bb11ba40f41 is going to be updated. [ 809.517049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.517049] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 725820e7-6c36-42a7-b348-480790c19a52 with status ACTIVE [ 809.517049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.517049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.517049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.517049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.517790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.517790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.517790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.517790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.517790] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 725820e7-6c36-42a7-b348-480790c19a52 is going to be updated. [ 809.519582] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.519752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.519752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.519919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.520058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.520228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e743ea5-9d4c-4834-84de-7bb11ba40f41" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.553707] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.553929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.553979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.554276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.554519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.554743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.632165] env[69274]: INFO networking_nsxv3.common.synchronization [req-7eb56174-d78e-4f77-a1db-d0c06bbddf8b req-0a7af130-5c03-454a-9804-e209b99bf117 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 809.632165] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 809.632165] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.632349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.632349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.632578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.632766] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.632862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.632922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.633304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.633395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.633492] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.993061] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.999136] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.097543] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.097745] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.097869] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.098179] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.098435] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.098600] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.098804] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.099069] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.099258] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.099615] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.099784] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.099922] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.100073] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.100222] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.100402] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.101214] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.119760] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.119851] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 810.119943] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.120145] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.120463] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.120635] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.120757] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.121212] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.121318] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.135322] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.195464] env[69274]: INFO networking_nsxv3.common.synchronization [req-4ee59a89-1ede-4080-90c4-374dc2dd0d08 req-81656031-f8b4-4355-9ae9-ce7e9bc9458d tempest-ServersNegativeTestMultiTenantJSON-121196380 tempest-ServersNegativeTestMultiTenantJSON-121196380-project-member] Enqueued Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_members [ 810.196087] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGHEST for action security_group_members [ 810.196397] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.196516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.196609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.196849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.200213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.200375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.200468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.200718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.200838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.200971] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.495151] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.495151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.495315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.495420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.495491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.495592] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be updated. [ 810.501789] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.503884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.503884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.503884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.503884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.503884] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 is going to be created. [ 810.524313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.524509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.524595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.524853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.525063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.526936] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.527074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.527129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.527294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.527418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.538025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: IN_PROGRESS for 2s [ 810.538764] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 in Status: UNINITIALIZED for 2s [ 810.624503] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.624726] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.624941] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.625287] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.625570] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.625697] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa not found, creating... [ 810.625986] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.626619] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.626760] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.627019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.627262] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.627617] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.627808] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.627932] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.628173] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.628314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.628534] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa is going to be created. [ 810.640486] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.663327] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.663541] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.663695] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.664085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.664360] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.664622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.712411] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.712411] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.712411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.712411] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efef42a0-7879-4e5e-b07d-896b827035c2 is going to be updated. [ 810.763716] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.763972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.763972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.764180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.765028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.994847] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efef42a0-7879-4e5e-b07d-896b827035c2 in Status: IN_PROGRESS for 2s [ 811.143056] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.143056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.143257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.143429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.143579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.143751] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 811.179333] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.179714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.179714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.180367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.180583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.194170] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 811.443715] env[69274]: INFO networking_nsxv3.common.synchronization [req-7eb56174-d78e-4f77-a1db-d0c06bbddf8b req-767e5c51-b551-4063-810f-c40a860c10b3 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 811.443927] env[69274]: INFO networking_nsxv3.common.synchronization [req-7eb56174-d78e-4f77-a1db-d0c06bbddf8b req-767e5c51-b551-4063-810f-c40a860c10b3 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 811.444057] env[69274]: INFO networking_nsxv3.common.synchronization [req-7eb56174-d78e-4f77-a1db-d0c06bbddf8b req-767e5c51-b551-4063-810f-c40a860c10b3 service nova] Enqueued Resource ID: eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa with Priority: HIGHEST for action port [ 811.444588] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 811.444731] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 811.444966] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa with Priority: HIGHEST for action port [ 811.445474] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.445597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.445740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.445867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.445949] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.447051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.447051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.447225] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.447316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.447381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.447547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.447621] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.715125] env[69274]: INFO networking_nsxv3.common.synchronization [req-813e911d-4087-4e68-b835-b10bbf789d19 req-9e247f9e-9b74-470d-bf84-43f860ff7f21 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 811.715650] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 811.715991] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.716117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.730843] env[69274]: INFO networking_nsxv3.common.synchronization [req-813e911d-4087-4e68-b835-b10bbf789d19 req-9e247f9e-9b74-470d-bf84-43f860ff7f21 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 811.731442] env[69274]: INFO networking_nsxv3.common.synchronization [req-813e911d-4087-4e68-b835-b10bbf789d19 req-9e247f9e-9b74-470d-bf84-43f860ff7f21 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 811.731694] env[69274]: INFO networking_nsxv3.common.synchronization [req-813e911d-4087-4e68-b835-b10bbf789d19 req-9e247f9e-9b74-470d-bf84-43f860ff7f21 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 725820e7-6c36-42a7-b348-480790c19a52 with Priority: HIGHEST for action port [ 811.731926] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_rules [ 811.732066] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 811.732167] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725820e7-6c36-42a7-b348-480790c19a52 with Priority: HIGHEST for action port [ 811.732859] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.732963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.733592] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.733753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.733930] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-725820e7-6c36-42a7-b348-480790c19a52 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.734047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.734175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.734316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.734397] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725820e7-6c36-42a7-b348-480790c19a52',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.949441] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.949441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.951789] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa with status ACTIVE [ 811.951987] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.952123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.952192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.952401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.952495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.952877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.953012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.953093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.953272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.953417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.953549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.953650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.953714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.953951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.954709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.954709] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa is going to be updated. [ 811.978175] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.978175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.978175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.978458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.978458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.978600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eacddde5-5ce6-4b78-a1fc-2dd9faf6d9aa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.236349] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 725820e7-6c36-42a7-b348-480790c19a52 with status ACTIVE [ 812.236614] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.236790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.236884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.237411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.237557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.237759] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.237866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.238254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.238473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.238563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.238762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.238866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.238928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.240186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.240292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.240387] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 725820e7-6c36-42a7-b348-480790c19a52 is going to be updated. [ 812.270233] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.270498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.270498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.270640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.270795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.270958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-725820e7-6c36-42a7-b348-480790c19a52" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.294814] env[69274]: INFO networking_nsxv3.common.synchronization [req-e5ed46a7-2e55-4b2c-baaf-1c4ee2278b61 req-50193d64-bf9e-4b4b-87a1-13e8e23d67b2 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 812.296057] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 812.296382] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.296516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.296585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.296789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.296941] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.297054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.297117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.297267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.297354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.297447] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.554046] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 in Status: SUCCESS [ 812.554298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.555066] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: SUCCESS [ 812.555256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.555384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.555598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.555786] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.555903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.555981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.556156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.556245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.556352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.556448] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.561787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.561787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.561787] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.561787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.561787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.561787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.561787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.561787] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.799726] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.831051] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.831051] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.831425] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.832050] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.832288] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.832483] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.832574] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.832908] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.833080] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.833303] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.833419] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.833531] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.833658] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.833777] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.833907] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.834121] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.886290] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.886514] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.886678] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.886882] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-167" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.887274] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-918de5b5-6c4e-449c-bb00-ad179b32baa2 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.887498] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.887611] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.887998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.888681] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918de5b5-6c4e-449c-bb00-ad179b32baa2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.011151] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efef42a0-7879-4e5e-b07d-896b827035c2 in Status: SUCCESS [ 813.011708] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efef42a0-7879-4e5e-b07d-896b827035c2 deletion is rescheduled due to dependency. [ 813.011708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.062366] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.062643] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.205372] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 813.205496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.205682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.206263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.206263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.206416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.206416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.206584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.206699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.206832] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.303186] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.393118] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.393118] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.393306] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.393477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.393638] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.394812] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 918de5b5-6c4e-449c-bb00-ad179b32baa2 not found, creating... [ 813.394812] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.395016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.395128] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.395390] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.395540] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.395849] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.396035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.396167] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.396469] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.396629] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.396780] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 is going to be created. [ 813.421675] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.421954] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.422192] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.422588] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.422866] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.423659] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.564840] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3e0de07-3f69-422a-b96d-525b1f2d6a80: rpc.has_security_group_logging(os_id): False [ 813.568202] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.592042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.592042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.592299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.592343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.592433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.592683] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.592781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.592835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.593038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.593092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.593160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 is going to be created. [ 813.677186] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.677402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.677402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.677603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.677779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.691631] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 in Status: IN_PROGRESS for 2s [ 813.710903] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.805924] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.806159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.806159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.806465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.806581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.806690] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 813.841861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.842062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.842138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.842414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.842610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.853448] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 814.070459] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.070691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.070691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.070904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.071016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.071120] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be updated. [ 814.109480] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.109480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.109480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.109809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.109809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.121609] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: IN_PROGRESS for 2s [ 814.214572] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.419786] env[69274]: INFO networking_nsxv3.common.synchronization [req-e5ed46a7-2e55-4b2c-baaf-1c4ee2278b61 req-ee1457ab-61de-4c62-bab7-446edfa9d0f7 service nova] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 814.419786] env[69274]: INFO networking_nsxv3.common.synchronization [req-e5ed46a7-2e55-4b2c-baaf-1c4ee2278b61 req-ee1457ab-61de-4c62-bab7-446edfa9d0f7 service nova] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 814.419786] env[69274]: INFO networking_nsxv3.common.synchronization [req-e5ed46a7-2e55-4b2c-baaf-1c4ee2278b61 req-ee1457ab-61de-4c62-bab7-446edfa9d0f7 service nova] Enqueued Resource ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 with Priority: HIGHEST for action port [ 814.419786] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 814.419786] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 814.420282] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 with Priority: HIGHEST for action port [ 814.420282] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.420282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.420410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.420516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.420636] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.427448] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.427574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.427795] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-918de5b5-6c4e-449c-bb00-ad179b32baa2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.427910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.428020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.428198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.428279] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918de5b5-6c4e-449c-bb00-ad179b32baa2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.720737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.720924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.721091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.721205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.721299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.721397] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 814.759038] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.759222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.759290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.759471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.759643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.770029] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 814.931095] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.931868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.931868] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 918de5b5-6c4e-449c-bb00-ad179b32baa2 with status ACTIVE [ 814.931868] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.931868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.931868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.932176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.932176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.932351] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.932448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.932512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.932694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.933129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.933129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.933129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.933129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.933408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.933408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.933408] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 is going to be updated. [ 814.975023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.975023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.975023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.975023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.975023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.975023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.311943] env[69274]: INFO networking_nsxv3.common.synchronization [req-6b9c3b8f-e923-4f74-89af-461ef49deaba req-76949b2d-1178-459c-9891-dff8a284d249 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_members [ 815.312428] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_members [ 815.312761] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.312909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.312978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.313617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.313617] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.313617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.313617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.313902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.313902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.313966] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.675637] env[69274]: INFO networking_nsxv3.common.synchronization [req-dfe88507-edf6-4287-8d21-8982ddcd5848 req-7bac35be-c793-457a-b75b-6c9027425d37 tempest-AttachInterfacesUnderV243Test-1646687414 tempest-AttachInterfacesUnderV243Test-1646687414-project-member] Enqueued Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 815.676214] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 with Priority: HIGHEST for action security_group_members [ 815.676530] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.676642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.708879] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 in Status: SUCCESS [ 815.709450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.816301] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.816450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.816450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.818037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.818037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.818037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.818037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.818037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.818037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.818037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.818037] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 already deleted. [ 815.818037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.835503] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.835708] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.835839] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.836199] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.836468] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.836626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.836747] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.836974] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.837327] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.837544] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.837662] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.837773] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.841022] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.841022] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.841022] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.841022] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.858403] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.858591] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.858731] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.858914] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.859290] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.859469] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.859613] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.859970] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.860150] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a73d2d4-fc07-4c28-aa98-f2b1f0631318',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.862610] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 815.863018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.863018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.863157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.863324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.863433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.863498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.863663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.863789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.863889] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.132912] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: SUCCESS [ 816.133176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.133352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.133572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.133765] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.133885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.133953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.134119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.134201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.134289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.134387] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.135773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.136374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.136597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.136753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.140026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.140026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.140026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.140026] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.364998] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.364998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.364998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.364998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.364998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.364998] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 7a73d2d4-fc07-4c28-aa98-f2b1f0631318 not found, creating... [ 816.364998] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.364998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.364998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.364998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.365473] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.365473] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.365653] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.366450] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.366689] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.366842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.367070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 7a73d2d4-fc07-4c28-aa98-f2b1f0631318 is going to be created. [ 816.368530] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.394913] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.395207] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.395207] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.396357] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.396357] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.396357] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.640145] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.641345] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.641529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.641700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.641927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.642053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.642330] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.642442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.642507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.642683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.642752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.642854] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be updated. [ 816.676547] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.676547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.676547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.677070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.677070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.686798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: IN_PROGRESS for 2s [ 816.782239] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 816.782462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.782997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.782997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.783161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.783225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.783276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.783572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.783572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.783572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.783712] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.872113] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.147106] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82: rpc.has_security_group_logging(os_id): False [ 817.167249] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.168108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.168298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.168636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.169535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.169535] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.169535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.169535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.169535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.169906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.170183] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be updated. [ 817.237187] env[69274]: INFO networking_nsxv3.common.synchronization [req-6b9c3b8f-e923-4f74-89af-461ef49deaba req-a99414c2-24d4-4af1-bdf8-6c408ae34f97 service nova] Enqueued Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_rules [ 817.237187] env[69274]: INFO networking_nsxv3.common.synchronization [req-6b9c3b8f-e923-4f74-89af-461ef49deaba req-a99414c2-24d4-4af1-bdf8-6c408ae34f97 service nova] Enqueued Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_members [ 817.237187] env[69274]: INFO networking_nsxv3.common.synchronization [req-6b9c3b8f-e923-4f74-89af-461ef49deaba req-a99414c2-24d4-4af1-bdf8-6c408ae34f97 service nova] Enqueued Resource ID: 7a73d2d4-fc07-4c28-aa98-f2b1f0631318 with Priority: HIGHEST for action port [ 817.237187] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_rules [ 817.237187] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_members [ 817.237187] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a73d2d4-fc07-4c28-aa98-f2b1f0631318 with Priority: HIGHEST for action port [ 817.237187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.237187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.237187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.238140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.238452] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.239759] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.240048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.240212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.240487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.240819] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.241054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.241216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.241467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.243017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.243017] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.243017] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.243354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.243515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.243767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.243951] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a73d2d4-fc07-4c28-aa98-f2b1f0631318',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.253021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.253021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.253021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.253021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.253021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.271349] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: IN_PROGRESS for 2s [ 817.287500] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.287724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.287724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.288017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.288231] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.288345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.288426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.288597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.288693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.288786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.288934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.289038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.289102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.289585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.289585] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.289585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.289585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.289825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.289825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.289825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.289933] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.375801] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.376028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.376028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.380036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.380036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.380036] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 817.413584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.413905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.413905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.414096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.414211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.429183] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 817.746987] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.746987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.746987] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.748072] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a73d2d4-fc07-4c28-aa98-f2b1f0631318 with status ACTIVE [ 817.748304] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.748438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.748522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.748795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.748924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.750845] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.751024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.755028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.755028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.755028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.755028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.755028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.755028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.755028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.755028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.755028] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a73d2d4-fc07-4c28-aa98-f2b1f0631318 is going to be updated. [ 817.779683] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.779930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.779930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.780163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.780298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.780463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a73d2d4-fc07-4c28-aa98-f2b1f0631318" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.793459] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 817.827187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.827187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.827187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.827371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.827552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.827742] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.827881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.827960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.828825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.828874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.830645] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.830645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.830645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.830645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.830645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.830645] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.830645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.830645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.831041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.831142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.831242] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 817.944122] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.944253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.944711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.944711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.944835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.981421] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 818.256786] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.700987] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: SUCCESS [ 818.701213] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 deletion is rescheduled due to dependency. [ 818.701309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.705023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.705023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.705023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.705023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.705023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.705023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.705023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.705023] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.758248] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.758646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.758646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.758776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.758776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.758889] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 is going to be created. [ 818.785276] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.785495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.785495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.785712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.785858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.798360] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 in Status: UNINITIALIZED for 2s [ 819.208070] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.208070] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.208070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.208070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be updated. [ 819.245990] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.246966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.246966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.246966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.246966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.264091] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: IN_PROGRESS for 2s [ 819.294102] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: SUCCESS [ 819.294435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.296431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.296643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.296730] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.441700] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 819.441700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.441700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.441700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.441887] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.441887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.441991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.442176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.442264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.442355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.442478] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.829353] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.829723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.829779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.830098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.830214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.830351] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be deleted. [ 819.923949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.924283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.924283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.924505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.924597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.924754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.944861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.946143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.946143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.946143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.946143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.946143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.946465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.946523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.946621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.946802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.947011] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.947211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.947299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.947517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.947740] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.947888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.947972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.948136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.948268] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.948390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.948498] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.003608] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 820.003608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.451883] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0551ddf-e014-4e0b-b17c-9e30f1dac015: rpc.has_security_group_logging(os_id): False [ 820.477078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.477078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.477078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.477078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.477078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.477424] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.477424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.477424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.478804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.478804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.478804] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.478804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.478804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.478804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.478804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.479257] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.479257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.479257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.479391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.479509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.479576] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 820.508210] env[69274]: INFO networking_nsxv3.common.synchronization [req-bd7558c0-80ac-40c9-bc97-c281ef9ba001 req-1d12fb43-e446-48c8-9ee4-5ef32a1c4763 tempest-ListServerFiltersTestJSON-1290336512 tempest-ListServerFiltersTestJSON-1290336512-project-member] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 820.508210] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 820.508210] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.508755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.508874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.509148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.509429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.509594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.509703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.509951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.510059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.510167] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.556982] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.557248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.557571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.557971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.558093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.581110] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 820.807972] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 in Status: SUCCESS [ 820.808216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.808379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.808593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.808781] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.808893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.811016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.811016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.811016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.811016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.811016] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.982073] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.982792] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.982792] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.982963] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.983347] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.983567] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.983699] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.983990] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.984189] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.984462] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.984783] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.984783] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.984953] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.985023] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.985163] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.985315] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.012248] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.012248] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.012248] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.012248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.012248] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-020e8e32-b0d4-426a-80c4-b16634bc3028 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.012248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.012248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.012248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.012248] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('020e8e32-b0d4-426a-80c4-b16634bc3028',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.018021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.018021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.018021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.020314] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 already deleted. [ 821.020314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.274581] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 in Status: SUCCESS [ 821.277841] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 deletion is rescheduled due to dependency. [ 821.277841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.277841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.277841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.277841] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.277841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.277841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.277841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.277841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.277841] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88601fb9-2b3d-42d7-ade7-5e91b9ca0e82',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.312021] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.467609] env[69274]: INFO networking_nsxv3.common.synchronization [req-c2f552e9-97be-412d-bb46-9749734e91ed req-87dca542-ae8e-4d65-a559-0a212558094b tempest-ServersTestManualDisk-1091924666 tempest-ServersTestManualDisk-1091924666-project-member] Enqueued Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_members [ 821.467609] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGHEST for action security_group_members [ 821.467609] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.467609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.468016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.468016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.468016] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.468131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.468215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.468343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.468431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.468527] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.523037] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.523037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.523037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.523037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.523037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.523037] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 020e8e32-b0d4-426a-80c4-b16634bc3028 not found, creating... [ 821.523598] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.523598] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.523598] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.523834] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.523875] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.524165] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.524315] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.524443] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.524681] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.524814] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.525385] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 020e8e32-b0d4-426a-80c4-b16634bc3028 is going to be created. [ 821.550180] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.550724] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.551163] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.551723] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.554072] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.554072] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.780570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.780570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.780570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.780994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.780994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.781482] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.781944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.781944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.782360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.782360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.782360] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88601fb9-2b3d-42d7-ade7-5e91b9ca0e82 is going to be deleted. [ 821.814865] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8836cb7d-c446-445d-9406-a28a71bb6de4: rpc.has_security_group_logging(os_id): False [ 821.842670] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.842901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.842993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.843590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.843590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.843797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.843879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.843879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.844269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.844385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.844483] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 is going to be created. [ 821.848286] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.848503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.848549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.848820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.848969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.849062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88601fb9-2b3d-42d7-ade7-5e91b9ca0e82" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.922739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.924076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.924076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.924076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.924076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.936732] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 in Status: IN_PROGRESS for 2s [ 821.971179] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.971448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.971448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.971933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.972240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.972604] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.972793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.972966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.973190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.973321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.973434] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 is going to be updated. [ 822.020175] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.020560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.020560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.020648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.020731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.044777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6c444ae-af25-4279-9215-0b11d2e72a27 in Status: IN_PROGRESS for 2s [ 822.288084] env[69274]: INFO networking_nsxv3.common.synchronization [req-be97c363-0bbc-49d6-b646-e7e87a09bdfa req-c6522fd8-1900-482c-aea9-ac4f2c26be32 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 822.288824] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 822.294030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.294030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.294030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.294030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.294290] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.294290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.294374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.295905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.295905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.295905] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.387289] env[69274]: INFO networking_nsxv3.common.synchronization [req-bd7558c0-80ac-40c9-bc97-c281ef9ba001 req-e40e3cb1-aaf5-4458-9e8c-34143da6a487 service nova] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_rules [ 822.387289] env[69274]: INFO networking_nsxv3.common.synchronization [req-bd7558c0-80ac-40c9-bc97-c281ef9ba001 req-e40e3cb1-aaf5-4458-9e8c-34143da6a487 service nova] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 822.387289] env[69274]: INFO networking_nsxv3.common.synchronization [req-bd7558c0-80ac-40c9-bc97-c281ef9ba001 req-e40e3cb1-aaf5-4458-9e8c-34143da6a487 service nova] Enqueued Resource ID: 020e8e32-b0d4-426a-80c4-b16634bc3028 with Priority: HIGHEST for action port [ 822.387289] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_rules [ 822.387289] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 822.387289] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 020e8e32-b0d4-426a-80c4-b16634bc3028 with Priority: HIGHEST for action port [ 822.387864] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.388102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.388360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.390633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.390633] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.390633] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.390825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.390825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.391078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.391566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.394601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.394601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.394601] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.394601] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-020e8e32-b0d4-426a-80c4-b16634bc3028 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.394601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.394601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.394601] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('020e8e32-b0d4-426a-80c4-b16634bc3028',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.599023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 822.599285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.797532] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.898213] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.898453] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.898453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.898632] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 020e8e32-b0d4-426a-80c4-b16634bc3028 with status ACTIVE [ 822.898768] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.898881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.898949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.899189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.899553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.899553] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.899553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.899757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.899870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.899914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.900711] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.902974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.902974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.902974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.902974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.902974] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 020e8e32-b0d4-426a-80c4-b16634bc3028 is going to be updated. [ 822.943112] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.943364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.943593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.943993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.944248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.944924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-020e8e32-b0d4-426a-80c4-b16634bc3028" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.300440] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.405489] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.805901] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.806183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.806183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.806365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.806446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.806612] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 823.838335] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.838335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.838335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.838335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.838335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.852141] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 823.909063] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.909063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.909063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.909362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.909362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.909362] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be created. [ 823.935790] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.935950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.936029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.936241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.936402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.951420] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: UNINITIALIZED for 2s [ 823.952556] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 in Status: SUCCESS [ 823.952879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.055190] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6c444ae-af25-4279-9215-0b11d2e72a27 in Status: SUCCESS [ 824.055541] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 deletion is rescheduled due to dependency. [ 824.055541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.434046] env[69274]: INFO networking_nsxv3.common.synchronization [req-055fae95-1846-401b-aeed-ae8e5bd2f132 req-9defef0f-4932-4739-83cc-f1f616a97a49 tempest-ListServerFiltersTestJSON-1290336512 tempest-ListServerFiltersTestJSON-1290336512-project-member] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 825.434046] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 825.437971] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.437971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.841027] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.841027] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.841027] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.841441] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.841441] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.841753] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.841753] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.842359] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.842544] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.842828] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.843071] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.843218] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.843338] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.843468] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 825.843713] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.843713] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.861574] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 825.861574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.866585] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.866768] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 825.866913] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.867455] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.867544] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.867684] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.867803] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.868135] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.868281] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.961923] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.964418] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.964418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.964418] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.967776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.967776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.967776] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.967776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.967776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.967776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.967776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.967776] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.190340] env[69274]: INFO networking_nsxv3.common.synchronization [req-1aae3cbc-8c0a-4212-8a63-b561a8b72a85 req-565fe33b-86eb-458f-8b17-b8ba3c194fd1 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 826.190562] env[69274]: INFO networking_nsxv3.common.synchronization [req-1aae3cbc-8c0a-4212-8a63-b561a8b72a85 req-565fe33b-86eb-458f-8b17-b8ba3c194fd1 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 826.191058] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 826.191207] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 826.191483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.191603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.191732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.191986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.193805] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.196029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.196029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.196029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.196029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.196029] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.196416] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.196416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.196416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.196641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.196871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.196984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.197074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.197250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.197354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.197486] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.239053] env[69274]: INFO networking_nsxv3.common.synchronization [req-1aae3cbc-8c0a-4212-8a63-b561a8b72a85 req-565fe33b-86eb-458f-8b17-b8ba3c194fd1 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_rules [ 826.239251] env[69274]: INFO networking_nsxv3.common.synchronization [req-1aae3cbc-8c0a-4212-8a63-b561a8b72a85 req-565fe33b-86eb-458f-8b17-b8ba3c194fd1 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 826.239417] env[69274]: INFO networking_nsxv3.common.synchronization [req-1aae3cbc-8c0a-4212-8a63-b561a8b72a85 req-565fe33b-86eb-458f-8b17-b8ba3c194fd1 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 826.239551] env[69274]: INFO networking_nsxv3.common.synchronization [req-1aae3cbc-8c0a-4212-8a63-b561a8b72a85 req-565fe33b-86eb-458f-8b17-b8ba3c194fd1 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 826.239752] env[69274]: INFO networking_nsxv3.common.synchronization [req-1aae3cbc-8c0a-4212-8a63-b561a8b72a85 req-565fe33b-86eb-458f-8b17-b8ba3c194fd1 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 with Priority: HIGHEST for action port [ 826.240296] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_rules [ 826.240778] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 826.240923] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 with Priority: HIGHEST for action port [ 826.243330] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 826.243464] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 826.245158] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.245158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.245158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.245158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.245158] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.250393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.250393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.250393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.250393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.250393] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.251741] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-918de5b5-6c4e-449c-bb00-ad179b32baa2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.251741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.251741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.251741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.251741] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918de5b5-6c4e-449c-bb00-ad179b32baa2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.252464] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.252543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.252728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.252839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.373927] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.374226] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.375055] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.375486] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.375718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.375915] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba not found, creating... [ 826.376282] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.376515] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.376667] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.377342] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.377543] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.378219] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.378641] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.378792] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.379431] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.380017] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.380180] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba is going to be created. [ 826.405124] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.405414] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.405553] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.405823] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.406065] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.406294] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.470588] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.470994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.472215] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.699307] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.701158] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.750219] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.750394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.753978] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.754121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.754307] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 918de5b5-6c4e-449c-bb00-ad179b32baa2 with status ACTIVE [ 826.754475] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.754585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.754653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.754872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.754990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.755184] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.755286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.755351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.755510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.755588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.755767] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.755863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.755926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.756079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.756156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.756242] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 is going to be updated. [ 826.783582] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.783582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.783582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.783582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.784065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.784065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.974983] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.175565] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.175886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.176017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.176302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.176475] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.204401] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.205413] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.255519] env[69274]: INFO networking_nsxv3.common.synchronization [req-055fae95-1846-401b-aeed-ae8e5bd2f132 req-66bf326a-5ca5-48ad-b321-ead5fa6c1d52 service nova] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_rules [ 827.255723] env[69274]: INFO networking_nsxv3.common.synchronization [req-055fae95-1846-401b-aeed-ae8e5bd2f132 req-66bf326a-5ca5-48ad-b321-ead5fa6c1d52 service nova] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 827.255868] env[69274]: INFO networking_nsxv3.common.synchronization [req-055fae95-1846-401b-aeed-ae8e5bd2f132 req-66bf326a-5ca5-48ad-b321-ead5fa6c1d52 service nova] Enqueued Resource ID: b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba with Priority: HIGHEST for action port [ 827.260402] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_rules [ 827.261367] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 827.261367] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba with Priority: HIGHEST for action port [ 827.261367] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.261873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.261873] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.261873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.262014] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.262014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.262121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.262299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.262380] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.479380] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.479979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.479979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.479979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.480246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.480246] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 827.512798] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.512997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.513062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.513426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.513426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.526339] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 827.679151] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.707762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.708118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.708118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.711232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.711361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.711447] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be created. [ 827.713623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.713783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.713867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.714121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.714215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.714299] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 827.742020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.742020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.742020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.742020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.742020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.743547] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.743885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.744063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.744467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.744750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.756221] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 827.756221] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: UNINITIALIZED for 2s [ 827.767021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba with status ACTIVE [ 827.767021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.767021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.767021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.767021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.767021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba is going to be updated. [ 827.792170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.792562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.792816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.793362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.793811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.794289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2bd7d21-628a-4dd4-9ab9-07da24c4d7ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.182157] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.299188] env[69274]: INFO networking_nsxv3.common.synchronization [req-842628b2-cce0-4b3e-8f81-c0af630cea62 req-c5a5103f-1c5f-4677-b6b1-e3e51d6cd43a tempest-ListServerFiltersTestJSON-1290336512 tempest-ListServerFiltersTestJSON-1290336512-project-member] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 828.299188] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 828.304469] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.304469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.687956] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 828.687956] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 828.824797] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-828 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.829029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.829029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.829029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.829029] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.829029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.829029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.829029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.829029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.829029] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.829029] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.829029] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.829029] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.829029] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.829029] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.829029] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.856079] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.856079] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.856079] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.856079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-828" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.856079] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-71818f83-2431-41b5-bca6-402419c1bfa2 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.856079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.856079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.856079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.857640] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71818f83-2431-41b5-bca6-402419c1bfa2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.360618] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.360885] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.361033] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.361363] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.361567] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.361794] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 71818f83-2431-41b5-bca6-402419c1bfa2 not found, creating... [ 829.362130] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.362302] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.362418] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.362658] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.362811] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.363473] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.363707] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.363876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.364206] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.364425] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.364618] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 71818f83-2431-41b5-bca6-402419c1bfa2 is going to be created. [ 829.404141] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.404141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.404141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.404141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.404141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.404892] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.539407] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 829.539649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.539979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.540258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.540386] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.540503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.540568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.540723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.540806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.540895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.541096] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.541184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.541239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.541376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.541516] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.541611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.541731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.541884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.541961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.544176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.544351] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.545282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.545466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.545630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.545733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.545904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.546170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.546170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.546388] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.718755] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.718755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.719466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.719466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.735956] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 829.735956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.735956] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 829.778460] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.778871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.778871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.779708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.792477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.793017] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 829.793114] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 829.793209] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 829.795084] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: SUCCESS [ 829.795297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.796079] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 829.796268] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.796799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.797019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.797225] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.797340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.797540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.797651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.797711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.797807] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.798694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.798886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.799072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.799183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.799246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.799397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.799471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.799559] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.841020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.841226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.841279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.841490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.843155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.843362] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 829.942910] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.943115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.943115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.943420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.945054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.945054] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 830.038791] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.038791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.038791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.038791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.039455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.039912] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 830.040184] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'118f1c99-f1b0-40d7-b8be-502ee4dd3ac7', '093f0a21-7741-4a8f-8410-d5b196f0f7d7', 'fd7d0f6f-e583-4619-be1a-10cbd86bd911', '8017f169-c9ea-4513-9df7-442186576b39', '7fa3cd7b-c562-43e1-96fe-99002d55eac1', '6e746a7b-3bcb-4275-9eab-0b5a5360426c', 'bc07b7c1-15e8-4533-9f0f-5fb201ac07b7', 'e13c3a51-4bc6-4f01-90fd-f18eece22adb', '6398991b-d5ff-4f53-a138-3545155245b1', '006dff36-9ba4-4e78-adb7-43e0f38d6a3e', '9e5932b9-8178-492f-bc28-0e93951e6eb4', 'd1440c9a-5782-4214-aa24-1446e4f91d71', '2c76c584-6c00-46aa-955a-014f7c87551a', 'ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a', '2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f', '63b31396-6061-4e77-9c4c-98a255b434be', '59b1a355-727a-429c-8793-e86ce70f75b8', 'c94ec27d-b5d9-4029-8581-29e1a1f41d8d', '76ed45ab-938f-474a-bc5b-d957fa7e4a5b', 'cebac9fe-4ea0-40a1-a949-d690687274d0', 'c216e0c6-b262-4569-8d09-772eeaa39501', 'df948508-d1d6-4368-979c-297ed94dda9d', 'a499f7e4-147f-443a-94fe-27f18e7a8418', '833fffe2-1aa6-4f10-9ea0-4e315ed92177', '15291f2b-281c-4bf0-a609-bcb369c82f51', 'da1c3475-4204-4218-9478-83b2e1605cd7', '8836cb7d-c446-445d-9406-a28a71bb6de4', 'c5cb0145-b4ca-4858-acad-7f67f4ef4d84', 'e6c444ae-af25-4279-9215-0b11d2e72a27', 'e0551ddf-e014-4e0b-b17c-9e30f1dac015', 'efc14d56-7e2f-4186-9451-37adac5c5b23', 'efef42a0-7879-4e5e-b07d-896b827035c2', 'b3522e3c-b40f-4d43-97bb-6926b26f91d0', '2840b5fb-3a8f-4d93-a381-953dc8e31a67', 'd3e0de07-3f69-422a-b96d-525b1f2d6a80', '55f154d6-8c77-4554-a90c-034e9602b91b', 'fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee', 'bf5386bc-1dac-4dfb-a842-4c99e33f110c'} {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 830.040467] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 830.050953] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6965fde-94e0-450b-9c8a-b2de7355cdc4: rpc.has_security_group_logging(os_id): False [ 830.052379] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.065146] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.065402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.065534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.065768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.065918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.066387] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 830.066532] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 830.066710] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 830.071183] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.071415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.071486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.071790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.072088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.072273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.072540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.072540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.072741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.072913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.073205] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.073820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.073820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.073820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.073820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.074130] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.074130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.074226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.074394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.074498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.074748] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be created. [ 830.149132] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.149132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.149132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.149132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.149132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.163195] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 830.168579] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.168739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.168809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.169113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.170118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.170421] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 830.170499] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 830.170573] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 830.170672] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 830.170767] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGH for action security_group_rules [ 830.172567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.254686] env[69274]: INFO networking_nsxv3.common.synchronization [req-842628b2-cce0-4b3e-8f81-c0af630cea62 req-28362b72-7750-492f-aa72-4f85ebbdb234 service nova] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_rules [ 830.255013] env[69274]: INFO networking_nsxv3.common.synchronization [req-842628b2-cce0-4b3e-8f81-c0af630cea62 req-28362b72-7750-492f-aa72-4f85ebbdb234 service nova] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 830.255393] env[69274]: INFO networking_nsxv3.common.synchronization [req-842628b2-cce0-4b3e-8f81-c0af630cea62 req-28362b72-7750-492f-aa72-4f85ebbdb234 service nova] Enqueued Resource ID: 71818f83-2431-41b5-bca6-402419c1bfa2 with Priority: HIGHEST for action port [ 830.256215] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_rules [ 830.256525] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 830.256841] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71818f83-2431-41b5-bca6-402419c1bfa2 with Priority: HIGHEST for action port [ 830.257040] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGH for action security_group_rules [ 830.257226] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGH for action security_group_rules [ 830.257300] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 with Priority: HIGH for action security_group_rules [ 830.257433] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGH for action security_group_rules [ 830.257660] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGH for action security_group_rules [ 830.257697] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b with Priority: HIGH for action security_group_rules [ 830.257803] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d with Priority: HIGH for action security_group_rules [ 830.257912] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b1a355-727a-429c-8793-e86ce70f75b8 with Priority: HIGH for action security_group_rules [ 830.258074] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGH for action security_group_rules [ 830.258251] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b31396-6061-4e77-9c4c-98a255b434be with Priority: HIGH for action security_group_rules [ 830.258551] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGH for action security_group_rules [ 830.258833] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1440c9a-5782-4214-aa24-1446e4f91d71 with Priority: HIGH for action security_group_rules [ 830.258986] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 with Priority: HIGH for action security_group_rules [ 830.258986] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGH for action security_group_rules [ 830.259174] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6398991b-d5ff-4f53-a138-3545155245b1 with Priority: HIGH for action security_group_rules [ 830.259377] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c with Priority: HIGH for action security_group_rules [ 830.259435] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb with Priority: HIGH for action security_group_rules [ 830.259672] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGH for action security_group_rules [ 830.259717] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGH for action security_group_rules [ 830.259881] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8017f169-c9ea-4513-9df7-442186576b39 with Priority: HIGH for action security_group_rules [ 830.260260] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.260438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.260748] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.260938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.261198] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-71818f83-2431-41b5-bca6-402419c1bfa2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.261317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.261422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.261586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.261669] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71818f83-2431-41b5-bca6-402419c1bfa2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.430944] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.431186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.431288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.431588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.431756] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.433111] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.433111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.433281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.433423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.433533] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.435318] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.435478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.435572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.435807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.435914] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc07b7c1-15e8-4533-9f0f-5fb201ac07b7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.437562] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.437736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.437831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.438080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.438189] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.439555] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.439696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.439785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.440127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.440127] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.441082] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.441199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.441238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.441399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.441491] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ed45ab-938f-474a-bc5b-d957fa7e4a5b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.442611] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.442781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.442781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.442975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.443062] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c94ec27d-b5d9-4029-8581-29e1a1f41d8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.443357] env[69274]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 830.444375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59b1a355-727a-429c-8793-e86ce70f75b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.444476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.444542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.444703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.444777] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59b1a355-727a-429c-8793-e86ce70f75b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.445655] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.445755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.445828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.445975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.446061] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.447036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b31396-6061-4e77-9c4c-98a255b434be taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.447154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.447206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.447341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.447414] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b31396-6061-4e77-9c4c-98a255b434be',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.448241] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.448356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.448425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.448577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.448652] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.449465] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1440c9a-5782-4214-aa24-1446e4f91d71 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.449672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.449672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.449818] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.450024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1440c9a-5782-4214-aa24-1446e4f91d71',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.450809] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5932b9-8178-492f-bc28-0e93951e6eb4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.450917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.450985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.451152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.451225] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5932b9-8178-492f-bc28-0e93951e6eb4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.452059] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.452165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.452231] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.452387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.452445] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.453296] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6398991b-d5ff-4f53-a138-3545155245b1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.453403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.453472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.453617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.453687] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6398991b-d5ff-4f53-a138-3545155245b1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.454588] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.454694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.454762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.454902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.454974] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e746a7b-3bcb-4275-9eab-0b5a5360426c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.456080] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.456080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.456080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.456250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.456250] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e13c3a51-4bc6-4f01-90fd-f18eece22adb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.456399] env[69274]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 830.457055] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.457167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.457233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.457382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.457455] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.458429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.458541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.458541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.458660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.458732] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.459523] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8017f169-c9ea-4513-9df7-442186576b39 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.459640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.459720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.459864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.459953] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8017f169-c9ea-4513-9df7-442186576b39',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.463909] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.465449] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.554664] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.964019] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71818f83-2431-41b5-bca6-402419c1bfa2 with status ACTIVE [ 830.964019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.964019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.964019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.964019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.964019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.964019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.964019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.964019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.964529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.964529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.964577] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.964758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.964808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.964969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.965081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.965188] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71818f83-2431-41b5-bca6-402419c1bfa2 is going to be updated. [ 830.966486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.966623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.966745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.966892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.968026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.968026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.968026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.968026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.968026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.968026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.968026] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.972018] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.972478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.972562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.972771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.972953] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.973081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.973152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.973311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.973396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.973488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.973572] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.974776] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.975639] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.001257] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.001466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.001580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.001861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.002089] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.002233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.003023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.003023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.003023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.003023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.003023] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.006371] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.006371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.006371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.006658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.007594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.007594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.007594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.007594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.007594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.007594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.007594] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.011411] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.011606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.011747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.012008] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.012229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.012368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.012525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.012717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.012803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.013109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.013241] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.018934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.018934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.019126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.019375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.019576] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.019794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.023022] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.023022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.023022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.023022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.023022] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.029083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.029083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.029083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.029083] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.035737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.036033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.036449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.036449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.036962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.036962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71818f83-2431-41b5-bca6-402419c1bfa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.044020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.044020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.044020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.044020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.064456] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.064664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.064766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.065309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.065309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.065309] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 831.080169] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.080351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.081352] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.081461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.082433] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.083274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.083841] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.083984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.084771] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.084916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.085621] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.085755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.091031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.091186] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e13c3a51-4bc6-4f01-90fd-f18eece22adb is going to be deleted. [ 831.092171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.092425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.100566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.100778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.104854] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.104988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.105882] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.106020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.106918] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.107143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.116067] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.116269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.121578] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 831.122265] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.122411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.122558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.122778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.122984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.125385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.125495] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8017f169-c9ea-4513-9df7-442186576b39 is going to be deleted. [ 831.126652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.126893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.138097] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 831.165208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.165372] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59b1a355-727a-429c-8793-e86ce70f75b8 is going to be deleted. [ 831.166397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.169088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.169088] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.169088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.222441] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.222761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.227829] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 831.228637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.228847] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e746a7b-3bcb-4275-9eab-0b5a5360426c is going to be deleted. [ 831.229919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.230171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.310561] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.310561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.313888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.313888] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ed45ab-938f-474a-bc5b-d957fa7e4a5b is going to be deleted. [ 831.315289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.315598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.349758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.349929] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6398991b-d5ff-4f53-a138-3545155245b1 is going to be deleted. [ 831.351331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.351331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.362921] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.363170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.408885] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.409022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.411950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.411950] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c94ec27d-b5d9-4029-8581-29e1a1f41d8d is going to be deleted. [ 831.413340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.413340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.439422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.439863] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be deleted. [ 831.440827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.441271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.472320] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.472589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.476123] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.480174] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.480367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.480401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.481511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.481511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.481511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.481511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.481511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.481511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.481511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.481817] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.481817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.481962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.482187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.482394] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.482560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.482715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.483283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.484124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.484428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.486822] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.486822] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.486822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.486822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.486822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.486822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.487717] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 831.490681] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.490681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.490822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.492256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.492256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.492256] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be updated. [ 831.495596] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 831.507046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.507046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.507046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.507046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.507620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.507620] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.507691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.507896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.507958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.508220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.508489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.508577] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.509965] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.515986] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.524390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.524390] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b31396-6061-4e77-9c4c-98a255b434be is going to be deleted. [ 831.524390] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.524390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.524909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.528192] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.528600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.528764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.529291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.529571] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.529814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.529956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.530226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.530417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.530802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.531083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.531569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.531732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.531993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.533964] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.533964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.533964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.533964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.533964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.533964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.533964] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.535802] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.546388] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.546625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.561515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.561819] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1440c9a-5782-4214-aa24-1446e4f91d71 is going to be deleted. [ 831.563596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.563596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.578109] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.578109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.589522] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.589522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.597124] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.597124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.597124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.597124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.597124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.598359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.598659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.598923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.599470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.599723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.616198] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 831.616820] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: IN_PROGRESS for 2s [ 831.625903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.626106] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5932b9-8178-492f-bc28-0e93951e6eb4 is going to be deleted. [ 831.627700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.627982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.638377] env[69274]: INFO networking_nsxv3.common.synchronization [req-eb2faab8-fe70-4ce3-ada0-1a253809d00b req-083f1a81-fb9f-4d77-9050-8923452843fb tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 831.638498] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 831.639792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.639792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.639792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.639792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.639792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.639792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.639792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.640164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.640164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.640269] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.649339] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.649740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.715034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc07b7c1-15e8-4533-9f0f-5fb201ac07b7 is going to be deleted. [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e13c3a51-4bc6-4f01-90fd-f18eece22adb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.715034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.715928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8017f169-c9ea-4513-9df7-442186576b39" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.716847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.717274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.717478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.717716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59b1a355-727a-429c-8793-e86ce70f75b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.717983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.718263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.718437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.718665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e746a7b-3bcb-4275-9eab-0b5a5360426c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.718937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.719207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.719397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.719609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ed45ab-938f-474a-bc5b-d957fa7e4a5b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.719874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.720142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.720302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.720500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6398991b-d5ff-4f53-a138-3545155245b1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.721516] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.721824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.722034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.724036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.724036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.724036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1440c9a-5782-4214-aa24-1446e4f91d71" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.724036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.724036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.773114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.773511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.773669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.773790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.774079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.774220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.774578] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.774752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.774859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.775156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.775244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.776240] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.776370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.776419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.776609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.776695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.776805] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 831.778118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.778325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.778421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.778548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c94ec27d-b5d9-4029-8581-29e1a1f41d8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.778728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.779033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.779033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.779141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b31396-6061-4e77-9c4c-98a255b434be" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.779356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.779561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.779643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.779791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.844286] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.844478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.844478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.845124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.845124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.845124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5932b9-8178-492f-bc28-0e93951e6eb4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.887758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.887962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.888026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.888257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.888366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.888461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc07b7c1-15e8-4533-9f0f-5fb201ac07b7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.954065] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 831.954671] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.954923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.955039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.955317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.955495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.980697] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7: rpc.has_security_group_logging(os_id): False [ 832.011938] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 832.012201] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa3cd7b-c562-43e1-96fe-99002d55eac1: rpc.has_security_group_logging(os_id): False [ 832.013608] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cebac9fe-4ea0-40a1-a949-d690687274d0: rpc.has_security_group_logging(os_id): False [ 832.017681] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 006dff36-9ba4-4e78-adb7-43e0f38d6a3e: rpc.has_security_group_logging(os_id): False [ 832.028938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.029151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.029280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.029760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.030949] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a: rpc.has_security_group_logging(os_id): False [ 832.038134] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c76c584-6c00-46aa-955a-014f7c87551a: rpc.has_security_group_logging(os_id): False [ 832.040071] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f: rpc.has_security_group_logging(os_id): False [ 832.049838] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.050029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.051979] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.052152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.063456] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.063730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.065374] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.065374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.073300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.073686] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.074475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.074475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.074475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.074475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.074475] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 is going to be updated. [ 832.075595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.075818] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.080261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.080261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.084528] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.084784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.143393] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.263630] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 832.263716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.264933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.268021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.268021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.268021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.268021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.268699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.268699] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be updated. [ 832.268699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.268881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.268948] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.269835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.270133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.317483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.317629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.332971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.332971] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.332971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.332971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.333293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.333293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.333293] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be updated. [ 832.334565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.334727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.389874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.390027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.390093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.390143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.390367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.390464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.390561] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e is going to be updated. [ 832.392071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.392273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.445659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.445808] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.445910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.445942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.446170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.446265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.447035] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be updated. [ 832.447636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.447839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.447990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.448998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.449195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.473274] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.473274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.487896] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: IN_PROGRESS for 2s [ 832.489154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.489560] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.490106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.490106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.490340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.490486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.490639] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a is going to be updated. [ 832.492177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.497510] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.497510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.504738] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.504901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.541442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.541858] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.542088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.542166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.542394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.542488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.542987] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.543214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.543336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.543535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.543627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.543863] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.543963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.544153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.544395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.544479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.544642] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 832.546573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.546748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.546955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.547851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.548041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.548342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.549374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.549556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.549746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.630722] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: IN_PROGRESS for 2s [ 832.631644] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: IN_PROGRESS for 2s [ 832.638642] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: IN_PROGRESS for 2s [ 832.648175] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.658683] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.658683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.658683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.658683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.658683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.661483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.662122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.662439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.662911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.663243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.692921] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: IN_PROGRESS for 2s [ 832.698359] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: IN_PROGRESS for 2s [ 832.752799] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.752799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.752799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.752799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.752799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.772743] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.772883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.782876] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 833.150161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.150424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.150424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.150712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.150712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.150851] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 833.154348] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 833.154348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.154348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.154348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.154348] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.154348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.154348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.154348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.154567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.154567] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.198382] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.199510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.199510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.199510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.200470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.215605] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 833.382750] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 833.383131] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_members [ 833.383210] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 833.383854] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 833.383979] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_members [ 833.384214] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 833.384624] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.384816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.385140] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.385302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.385440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.385779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.386066] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.386177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.386276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.386586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.386725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.386856] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.388303] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.388437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.441963] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_rules [ 833.442163] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 833.442340] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_rules [ 833.442491] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_members [ 833.442658] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 833.442944] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 833.443099] env[69274]: INFO networking_nsxv3.common.synchronization [req-f007d30e-4b56-4181-a3a9-0aeef2f01b08 req-dbb9b66e-2c8b-429a-b2bb-07ce29a446b9 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 with Priority: HIGHEST for action port [ 833.443755] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_rules [ 833.443948] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_rules [ 833.444073] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 833.444171] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 with Priority: HIGHEST for action port [ 833.444264] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_rules [ 833.444370] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 833.444489] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_members [ 833.444792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.444899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.445114] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.445613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.445613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.445877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.445965] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.447635] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.447780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.448015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-918de5b5-6c4e-449c-bb00-ad179b32baa2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.448143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.448222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.448456] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.448542] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918de5b5-6c4e-449c-bb00-ad179b32baa2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.449407] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.449500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.449679] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.449780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.450015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.450120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.627497] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 833.627815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.628051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.628309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.628504] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.628695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.628750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.629216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.629216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.629216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.629216] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.630779] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: SUCCESS [ 833.630958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.631124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.631293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.631487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.631563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.631635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.632080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.632080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.632080] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.632805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.633206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.633206] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.633314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.633314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.633438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.633510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.633591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.633672] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.634663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.634880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.635055] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.635139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.635199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.635534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.635534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.635534] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.657316] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.889947] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.951386] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.951526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.951716] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 918de5b5-6c4e-449c-bb00-ad179b32baa2 with status ACTIVE [ 833.951904] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.952050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.952142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.952313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.952400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.952569] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.952665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.952767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.952905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.952988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.953600] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.953600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.953600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.953600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.953600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.953918] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 918de5b5-6c4e-449c-bb00-ad179b32baa2 is going to be updated. [ 833.990272] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.990272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.990272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.990469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.990628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.990714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-918de5b5-6c4e-449c-bb00-ad179b32baa2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.031463] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 834.031463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.135073] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.136656] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.136656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.136656] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.140327] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.160938] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.392389] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.504990] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: SUCCESS [ 834.506036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.638928] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa1a9a97-83f8-48ba-9ef7-ddec60300629: rpc.has_security_group_logging(os_id): False [ 834.640026] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.642483] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.647879] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 834.648084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.648895] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 834.649158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.653844] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: SUCCESS [ 834.654052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.659675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.659893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.659893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.660105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.660196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.660439] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.660528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.660618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.660801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.660883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.660972] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be created. [ 834.664515] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.664515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.664515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.664515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.664515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.664515] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 834.692033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.692033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.692033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.692033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.692033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.702653] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 834.708014] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: SUCCESS [ 834.709909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.710134] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 834.710326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.715370] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.715370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.715370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.715571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.715690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.743357] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: IN_PROGRESS for 2s [ 834.806062] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 834.806388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.895474] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.895633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.895708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.896698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.896698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.896698] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f is going to be created. [ 834.925040] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.925234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.925308] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.925529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.925698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.936283] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f in Status: UNINITIALIZED for 2s [ 835.147425] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.147868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.147868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.147868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.148011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.148072] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 835.149907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.150075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.150193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.150322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.152345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.152345] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be updated. [ 835.194624] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.194891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.194891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.195752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.195752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.197857] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.198022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.198286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.198467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.202029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.211983] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: IN_PROGRESS for 2s [ 835.212738] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 835.228965] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 835.229064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.306569] env[69274]: INFO networking_nsxv3.common.synchronization [req-da5fb962-d3d3-4c2e-ba16-75af4ec1b646 req-fecbfbc2-a629-428d-bd40-5b7d3f395c15 tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 835.307178] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 835.307504] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.307640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.310168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.310168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.310168] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.310168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.310168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.310168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.310168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.310168] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.813012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.813012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.813122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.813303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.813368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.813559] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.813651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.814302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.815350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.815350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.815350] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 already deleted. [ 835.815350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.878286] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.878598] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.878813] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.879207] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.879505] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.879665] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.882023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.882023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.882023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.882023] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.882023] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.882023] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.882023] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.882023] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.882023] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.882023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.908397] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.910279] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.910279] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.910279] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.910279] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.910279] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.910553] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.910881] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.911813] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d8303e-296d-4f45-8f1a-22f5ece0be9f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.310869] env[69274]: INFO networking_nsxv3.common.synchronization [req-e8077483-ed6a-484e-8302-7ed52165d98c req-4f63c4a6-1cba-4d82-8a58-a1a33c3689f8 tempest-ServerActionsV293TestJSON-1995669322 tempest-ServerActionsV293TestJSON-1995669322-project-member] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_members [ 836.311532] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGHEST for action security_group_members [ 836.311878] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.311985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.312071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.312282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.312457] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.312562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.312624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.312811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.312912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.313018] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.416548] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.416853] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.417023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.417408] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.417665] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.417790] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b4d8303e-296d-4f45-8f1a-22f5ece0be9f not found, creating... [ 836.418179] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.418381] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.418543] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.418820] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.419964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.420407] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.420976] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.421505] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.421832] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.422029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.422207] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b4d8303e-296d-4f45-8f1a-22f5ece0be9f is going to be created. [ 836.445435] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.445861] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.445861] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.446139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.446312] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.446552] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.717279] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 836.717527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.717702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.720431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.720679] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.721150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.721150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.721150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.721297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.721336] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.757364] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: SUCCESS [ 836.757578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.757749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.757986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.758092] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.815897] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.816013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.816081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.816324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.816441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.816677] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.816802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.816890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.818279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.818279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.818279] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a is going to be updated. [ 836.846447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.846596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.846673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.846896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.847051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.857755] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: IN_PROGRESS for 2s [ 836.945568] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f in Status: SUCCESS [ 836.945819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.946016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.946285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.946491] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.946632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.946700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.946886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.946976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.947115] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.223658] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.235600] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: SUCCESS [ 837.237279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.237279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.237482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.237975] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.239240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.239240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.239240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.239240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.239240] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.241145] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 837.241417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.243895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.244201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.244411] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.244531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.244598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.244953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.245082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.245190] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.247717] env[69274]: INFO networking_nsxv3.common.synchronization [req-2fbc5226-71a9-483d-9a04-45bfb8088e32 req-90a25824-1e08-4eaa-9404-c4a997029c08 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_members [ 837.247908] env[69274]: INFO networking_nsxv3.common.synchronization [req-2fbc5226-71a9-483d-9a04-45bfb8088e32 req-90a25824-1e08-4eaa-9404-c4a997029c08 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 837.248065] env[69274]: INFO networking_nsxv3.common.synchronization [req-2fbc5226-71a9-483d-9a04-45bfb8088e32 req-90a25824-1e08-4eaa-9404-c4a997029c08 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 837.250244] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f with Priority: HIGHEST for action security_group_members [ 837.250374] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 837.250478] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGHEST for action security_group_members [ 837.250783] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.251026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.251501] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.251501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.251501] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.251686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.261892] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.262062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.452707] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.452707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.453207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.453207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.453261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.453816] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.453816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.453816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.453816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.454022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.454022] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f is going to be deleted. [ 837.483606] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.483935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.484078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.484377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.484518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.484662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.484886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.485130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.485343] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.485590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.485590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.485761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.485880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.485981] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.521291] env[69274]: INFO networking_nsxv3.common.synchronization [req-da5fb962-d3d3-4c2e-ba16-75af4ec1b646 req-0418015f-8720-4b30-9d85-e3ff763f682d service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 837.521479] env[69274]: INFO networking_nsxv3.common.synchronization [req-da5fb962-d3d3-4c2e-ba16-75af4ec1b646 req-0418015f-8720-4b30-9d85-e3ff763f682d service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 837.521623] env[69274]: INFO networking_nsxv3.common.synchronization [req-da5fb962-d3d3-4c2e-ba16-75af4ec1b646 req-0418015f-8720-4b30-9d85-e3ff763f682d service nova] Enqueued Resource ID: b4d8303e-296d-4f45-8f1a-22f5ece0be9f with Priority: HIGHEST for action port [ 837.522134] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 837.523489] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 837.523718] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d8303e-296d-4f45-8f1a-22f5ece0be9f with Priority: HIGHEST for action port [ 837.524097] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.524280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.524385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.524698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.524827] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.526164] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.526290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.526363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.526559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.526730] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.526832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.526899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.527109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.527210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.527312] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.528236] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.528621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.528791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.529029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.529181] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d8303e-296d-4f45-8f1a-22f5ece0be9f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.730353] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.747056] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.751871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.751871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.751871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.751871] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be updated. [ 837.781673] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.781673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.781673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.781673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.781673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.797408] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: IN_PROGRESS for 2s [ 837.988230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.988661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.988866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.989961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.989961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.989961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.989961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.989961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.990460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.990986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.990986] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f already deleted. [ 837.990986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.991166] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.996387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.996387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.996387] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.996387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.996630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.996630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.996725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.996795] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.031725] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.031725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.031725] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.033113] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4d8303e-296d-4f45-8f1a-22f5ece0be9f with status ACTIVE [ 838.033113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.033113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.033113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.033113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.033113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.033113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.033559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.033559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.033559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.033559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.033667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.033778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.033778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.033924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.034017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.034077] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4d8303e-296d-4f45-8f1a-22f5ece0be9f is going to be updated. [ 838.057553] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.057553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.057553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.057553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.057553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.057553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d8303e-296d-4f45-8f1a-22f5ece0be9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.235886] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.235886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.235886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.235886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.235886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.235886] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 838.249593] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.291694] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.292027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.292115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.292426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.292663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.314501] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 838.495588] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.501019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.501019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.501019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.501585] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f already deleted. [ 838.501585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.535886] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.751884] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.752100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.752150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.752438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.752651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.752748] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 838.785191] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.785371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.785410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.785617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.786017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.798045] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 838.868936] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c76c584-6c00-46aa-955a-014f7c87551a in Status: SUCCESS [ 838.869148] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a deletion is rescheduled due to dependency. [ 838.869272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.998121] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f: rpc.has_security_group_logging(os_id): False [ 839.019484] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.019696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.019805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.020106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.020251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.020594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.020715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.020811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.020993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.021087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.021184] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f is going to be created. [ 839.039340] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.039614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.039727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.039983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.040101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.040209] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be created. [ 839.048563] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f], does not exist path=[/infra/domains/default/groups/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f]."\n}' [ 839.048563] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f [ 839.048563] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 839.066945] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.067111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.067182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.067398] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.067563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.081098] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: UNINITIALIZED for 2s [ 839.089457] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.089457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.089457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.089457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.089831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.091353] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.091353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.091353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.091611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.091646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.091947] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.092106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.092203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.092446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.092554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.092674] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f is going to be created. [ 839.113167] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f], does not exist path=[/infra/domains/default/groups/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f [ 839.113367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.114012] env[69274]: Traceback (most recent call last): [ 839.114135] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 839.114135] env[69274]: return func(*args, **kwargs) [ 839.114135] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 839.114135] env[69274]: res.raise_for_status() [ 839.114135] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 839.114135] env[69274]: raise HTTPError(http_error_msg, response=self) [ 839.114135] env[69274]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f [ 839.114135] env[69274]: During handling of the above exception, another exception occurred: [ 839.114135] env[69274]: Traceback (most recent call last): [ 839.114135] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 839.114135] env[69274]: listener.cb(fileno) [ 839.114135] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 839.114135] env[69274]: result = function(*args, **kwargs) [ 839.114135] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 839.114135] env[69274]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 839.114135] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 839.114135] env[69274]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 839.114135] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 839.114135] env[69274]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 839.114135] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 839.114135] env[69274]: res.raise_for_status() [ 839.114135] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 839.114135] env[69274]: raise HTTPError(http_error_msg, response=self) [ 839.114135] env[69274]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc7ac6c9-4233-4a70-ad5d-5d5bce19e94f [ 839.114135] env[69274]: Removing descriptor: 23 [ 839.809096] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: SUCCESS [ 839.809429] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 deletion is rescheduled due to dependency. [ 839.809429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.809429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.809611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.809849] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.809986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.810066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.810237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.810493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.810493] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.318680] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.318778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.318778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.319870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.331994] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 840.332702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.332702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.332702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.332702] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.332990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.332990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.333095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.333131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.333219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.333299] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.342466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.342466] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.342466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.342466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.342466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.342844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.342844] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be updated. [ 840.372151] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.372593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.372593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.372728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.372866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.387297] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: IN_PROGRESS for 2s [ 840.810217] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 840.810529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.810616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.811106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.811106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.811232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.811232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.811455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.811563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.811590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.811739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.811877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.812068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.812142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.812220] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.812308] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.812373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.812501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.812572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.812651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.812744] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.813755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.813930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.814100] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.814383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.814383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.814383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.814464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.814547] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.838790] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.839009] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.839116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.839297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.839511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.839655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.839830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.843136] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.843136] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.843136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.843136] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.093044] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 841.093044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.093199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.093324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.093524] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.093650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.093713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.093870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.094049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.094466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.094608] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.319526] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0551ddf-e014-4e0b-b17c-9e30f1dac015: rpc.has_security_group_logging(os_id): False [ 841.322715] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.339052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.339221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.339493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.339493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.346030] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6965fde-94e0-450b-9c8a-b2de7355cdc4: rpc.has_security_group_logging(os_id): False [ 841.376584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.376584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.380475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.380475] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.381536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.381536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.381714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.381954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.384310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.385432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.385432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.385432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.385432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.385432] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.385432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.385432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.385718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.385718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.385784] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 841.388296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.388296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.414070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.414359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.414482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.414555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.414780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.414894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.415196] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.415372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.415437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.415682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.415759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.415985] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.416301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.416371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.417030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.417030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.417030] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 841.496959] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.497157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.497226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.497741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.497926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.519544] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 841.564205] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.564205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.564205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.564205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.564205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.590252] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 841.600427] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.600427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.600427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.600427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.600427] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.600704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.600704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.600877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.600965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.601080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.601253] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.601895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.601895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.601895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.601895] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.601895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.602134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.603317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.603416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.603525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.603630] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.696755] env[69274]: INFO networking_nsxv3.common.synchronization [None req-4cf11be0-2f97-4ec8-b619-023f661d4f66 None None] Enqueued Resource ID: 17b51a24-8fd6-4839-bc5f-34444d20e0f1 with Priority: HIGHEST for action port [ 841.697442] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b51a24-8fd6-4839-bc5f-34444d20e0f1 with Priority: HIGHEST for action port [ 841.697776] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-17b51a24-8fd6-4839-bc5f-34444d20e0f1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.697902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17b51a24-8fd6-4839-bc5f-34444d20e0f1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.697973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17b51a24-8fd6-4839-bc5f-34444d20e0f1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.698277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17b51a24-8fd6-4839-bc5f-34444d20e0f1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.698371] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b51a24-8fd6-4839-bc5f-34444d20e0f1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.825615] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.107463] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1ed1d16-c48a-4859-8659-45390ac1d1a8: rpc.has_security_group_logging(os_id): False [ 842.131986] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.131986] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.131986] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.131986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.134998] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.135201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.135201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.135375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.135457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.135550] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be created. [ 842.200666] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17b51a24-8fd6-4839-bc5f-34444d20e0f1 [ 842.200968] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.201172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.201277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.201488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.201589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.201914] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17b51a24-8fd6-4839-bc5f-34444d20e0f1 already deleted. [ 842.201914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17b51a24-8fd6-4839-bc5f-34444d20e0f1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.208379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.208601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.208982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.208982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.209203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.223828] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 842.329594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.329594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.329594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.329594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.329594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.329993] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 842.369940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.369940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.369940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.369940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.369940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.384672] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 842.394580] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: SUCCESS [ 842.394580] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 deletion is rescheduled due to dependency. [ 842.394580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.394580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.394890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.394986] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.395133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.395196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.395364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.395447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.395533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.395623] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.775062] env[69274]: INFO networking_nsxv3.common.synchronization [None req-455588b2-ca16-4900-aa3a-ab33f1ec3b02 tempest-ServersV294TestFqdnHostnames-424206970 tempest-ServersV294TestFqdnHostnames-424206970-project-member] Enqueued Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_rules [ 842.775697] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_rules [ 842.775995] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.776141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.776238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.776502] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.776588] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.900726] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.970375] env[69274]: INFO networking_nsxv3.common.synchronization [None req-17d7ab5c-c268-411b-b09c-9a5a010a9a10 tempest-ServersV294TestFqdnHostnames-424206970 tempest-ServersV294TestFqdnHostnames-424206970-project-member] Enqueued Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_rules [ 842.974062] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_rules [ 842.974523] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.974631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.321754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.321754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.321754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.321754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.321754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.322856] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 already deleted. [ 843.323177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.323755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.323857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.324040] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.404015] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa1a9a97-83f8-48ba-9ef7-ddec60300629: rpc.has_security_group_logging(os_id): False [ 843.433024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.433024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.433024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.433024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.433024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.433342] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.433529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.433649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.433921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.434260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.434465] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be updated. [ 843.528509] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.529420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.529420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.529420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.529420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.548342] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: IN_PROGRESS for 2s [ 843.552017] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 843.552304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.552513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.553030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.553030] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.633065] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 843.633065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.633065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.633065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.633065] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.853661] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.853852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.853932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.854360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.854736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.854736] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 already deleted. [ 843.854736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.056794] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.056794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.135495] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.135641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.135719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.135944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.136130] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.136231] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.136296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.136482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.136582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.136786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.136786] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.243063] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 844.243435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.409464] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 844.411019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.411019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.411019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.411019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.411019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.411019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.411019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.411379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.411379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.411379] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.641579] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.641916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.642036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.642285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.642464] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.642606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.642673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.642838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.643017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.643112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.643207] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.643364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.643433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.643627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.643757] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.643861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.643921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.644076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.644163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.644385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.644385] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.702649] env[69274]: INFO networking_nsxv3.common.synchronization [None req-cb4a2757-25ee-4f20-872f-7e1bea0f5777 None None] Enqueued Resource ID: 1315bbd8-c8ca-474a-a8b0-bf61e330c8f0 with Priority: HIGHEST for action port [ 844.703347] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1315bbd8-c8ca-474a-a8b0-bf61e330c8f0 with Priority: HIGHEST for action port [ 844.703598] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1315bbd8-c8ca-474a-a8b0-bf61e330c8f0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.703755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1315bbd8-c8ca-474a-a8b0-bf61e330c8f0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.703837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1315bbd8-c8ca-474a-a8b0-bf61e330c8f0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.705539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1315bbd8-c8ca-474a-a8b0-bf61e330c8f0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.705646] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1315bbd8-c8ca-474a-a8b0-bf61e330c8f0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.726391] env[69274]: INFO networking_nsxv3.common.synchronization [req-df2fec18-ecf0-44e0-9d65-bb00c5760d48 req-537e6e2c-e66b-4937-8500-fcd6252fa76b tempest-VolumesAssistedSnapshotsTest-309329079 tempest-VolumesAssistedSnapshotsTest-309329079-project-member] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_members [ 844.728406] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGHEST for action security_group_members [ 844.728837] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.728959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.729230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.729478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.729718] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.729809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.729876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.730407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.730544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.730683] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.915014] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.915193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.915270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.915521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.915692] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.915910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.915910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.916040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.916089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.916182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.916337] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.916464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.916520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.916625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.916758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.916849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.916907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.917047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.917141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.917240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.917357] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.150024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6965fde-94e0-450b-9c8a-b2de7355cdc4: rpc.has_security_group_logging(os_id): False [ 845.173289] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.173546] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.177026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.177026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.177026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.177026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.177887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.177887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.177887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.177887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.177887] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 845.208653] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1315bbd8-c8ca-474a-a8b0-bf61e330c8f0 [ 845.208653] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.208653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.208653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.208653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.208653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.208653] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1315bbd8-c8ca-474a-a8b0-bf61e330c8f0 already deleted. [ 845.208653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1315bbd8-c8ca-474a-a8b0-bf61e330c8f0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.239189] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.239189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.239189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.239189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.256124] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.256124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.261680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.262047] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.262203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.262267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.262480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.262567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.262660] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 is going to be updated. [ 845.263755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.263943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.265030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.327542] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 845.338774] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.338959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.339087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.339903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.340101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.352796] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: IN_PROGRESS for 2s [ 845.423677] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0551ddf-e014-4e0b-b17c-9e30f1dac015: rpc.has_security_group_logging(os_id): False [ 845.448843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.449045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.449126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.449348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.449496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.449662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.449766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.449917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.450086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.453297] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.453297] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.453297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.453297] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 845.545395] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.545643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.545844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.546266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.546609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.568818] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 in Status: SUCCESS [ 845.568818] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.574711] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 845.759256] env[69274]: INFO networking_nsxv3.common.synchronization [req-61fad58f-a4cd-4c55-8b05-4a8f4260e7e9 req-c0346858-06ec-4ac7-a182-66ff2e187951 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 845.759509] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 845.760072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.760333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.760504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.760868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.761130] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.761348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.761497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.761797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.762283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.762457] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.198945] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.199379] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.199379] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.199630] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.200039] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.200239] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.200364] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.200607] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.200829] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.201635] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.201635] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.201635] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.201635] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.201635] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.201635] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.201927] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.222902] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.223137] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 846.223301] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.223505] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.223851] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-a6762356-a217-4909-ab73-965aec4c04c8 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.224050] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.224256] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.224608] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.225476] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6762356-a217-4909-ab73-965aec4c04c8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.265485] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.265657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.265731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.265973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.296827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.297117] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.297249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.297322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.297565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.297657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.297748] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 846.341278] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.341278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.341278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.341278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.341449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.365762] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 846.728090] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.728395] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.728507] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.728809] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.728975] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.729171] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port a6762356-a217-4909-ab73-965aec4c04c8 not found, creating... [ 846.729477] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.729674] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.729830] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.731604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.731604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.731604] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.731604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.731604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.731604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.731604] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.731604] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: a6762356-a217-4909-ab73-965aec4c04c8 is going to be created. [ 846.759279] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.759760] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.760147] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.760653] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.761066] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.761228] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.344563] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 847.344977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.364499] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 in Status: SUCCESS [ 847.364754] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 deletion is rescheduled due to dependency. [ 847.364886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.524023] env[69274]: INFO networking_nsxv3.common.synchronization [req-61fad58f-a4cd-4c55-8b05-4a8f4260e7e9 req-40577be5-4f0f-4754-83b5-770aba2f8e68 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 847.524023] env[69274]: INFO networking_nsxv3.common.synchronization [req-61fad58f-a4cd-4c55-8b05-4a8f4260e7e9 req-40577be5-4f0f-4754-83b5-770aba2f8e68 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 847.524023] env[69274]: INFO networking_nsxv3.common.synchronization [req-61fad58f-a4cd-4c55-8b05-4a8f4260e7e9 req-40577be5-4f0f-4754-83b5-770aba2f8e68 service nova] Enqueued Resource ID: a6762356-a217-4909-ab73-965aec4c04c8 with Priority: HIGHEST for action port [ 847.524023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 847.524023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 847.524023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6762356-a217-4909-ab73-965aec4c04c8 with Priority: HIGHEST for action port [ 847.524813] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.525210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.525422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.526831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.526831] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.527462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.528164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.528592] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6762356-a217-4909-ab73-965aec4c04c8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.528755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.528867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.529293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.529293] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6762356-a217-4909-ab73-965aec4c04c8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.595941] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 847.596159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.031646] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.031863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.032094] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6762356-a217-4909-ab73-965aec4c04c8 with status ACTIVE [ 848.032324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.032471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.032566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.032852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.032986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.033248] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.033382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.033474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.033691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.033802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.034254] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.034254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.034254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.034496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.034577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.034694] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6762356-a217-4909-ab73-965aec4c04c8 is going to be updated. [ 848.065195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.065417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.065417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.065697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.065933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.066146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6762356-a217-4909-ab73-965aec4c04c8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.377720] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 848.380023] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 848.380023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.380023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.380023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.380023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.380023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.380023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.380023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.380023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.380023] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.882287] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.962608] env[69274]: INFO networking_nsxv3.common.synchronization [req-cb03fcc9-a81b-46d1-be35-0cac6986639d req-d6470d86-0770-416e-90a9-8b66af7c9888 tempest-VolumesAdminNegativeTest-289876529 tempest-VolumesAdminNegativeTest-289876529-project-member] Enqueued Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_members [ 848.963504] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGHEST for action security_group_members [ 848.964415] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.964712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.964874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.965232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.965495] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.965730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.965890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.967307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.967307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.967307] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.388343] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.469775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.470196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.470336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.470674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.494796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.495103] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.495331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.495331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.495540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.495627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.495724] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 is going to be updated. [ 849.536964] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.537178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.537178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.538153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.538153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.549141] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 in Status: IN_PROGRESS for 2s [ 849.889058] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.889058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.889058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.889058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.889058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.889058] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 849.937949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.937949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.937949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.937949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.937949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.947185] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 851.558488] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 in Status: SUCCESS [ 851.558761] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 deletion is rescheduled due to dependency. [ 851.558904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.959999] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 851.961838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.961838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.962132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.962345] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.962470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.962538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.962919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.963095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.963305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.963463] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.466523] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.467819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.467819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.467819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.468360] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.468499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.468565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.471143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.471523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.471523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.471666] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.471666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.471759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.471922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.472112] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.472709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.472709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.472709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.472709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.472856] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.472856] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.977473] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c216e0c6-b262-4569-8d09-772eeaa39501: rpc.has_security_group_logging(os_id): False [ 852.997690] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.998949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.998949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.999481] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.999481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.999481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.999481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.999481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.999702] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.999702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.999833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.999880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.999919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.000115] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 853.070528] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.070711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.070747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.071618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.071618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.085748] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 853.965147] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.965266] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 854.042607] env[69274]: INFO networking_nsxv3.common.synchronization [req-15de9b3c-3667-400c-a917-9d67305a4073 req-c6ccfa21-392e-4ff8-bda0-064ed6fa363d tempest-MigrationsAdminTest-608694291 tempest-MigrationsAdminTest-608694291-project-member] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 854.043760] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 854.043760] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.044148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.044148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.044823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.045113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.045259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.045489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.045489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.045675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.045675] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.549326] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.670829] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.671168] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.671200] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.671462] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.671730] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.671916] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.673652] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.674034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.674261] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.674537] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.674726] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.675527] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.675727] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.675932] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.676172] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.676393] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.708904] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.709116] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 854.709306] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.709480] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-778" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.709946] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-11d5345c-4085-4b3a-8c75-9dd8f317a26e taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.710168] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.710299] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.710644] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.710792] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11d5345c-4085-4b3a-8c75-9dd8f317a26e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.058470] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.104893] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 855.104893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.218236] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.218526] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.219060] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.219060] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.219259] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.219780] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 11d5345c-4085-4b3a-8c75-9dd8f317a26e not found, creating... [ 855.219977] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.220234] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.220401] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.220696] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.220970] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.221440] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.222068] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.222068] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.222420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.222538] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.222696] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 11d5345c-4085-4b3a-8c75-9dd8f317a26e is going to be created. [ 855.253258] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.254545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.254545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.254545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.254545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.254982] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.561573] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.561813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.561977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.562445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.562581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.562694] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be updated. [ 855.609342] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.609622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.609755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.610110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.610313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.622800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: IN_PROGRESS for 2s [ 856.122186] env[69274]: INFO networking_nsxv3.common.synchronization [req-15de9b3c-3667-400c-a917-9d67305a4073 req-5230ff7b-a726-4583-8624-4ec51a6a0d87 service nova] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_rules [ 856.122511] env[69274]: INFO networking_nsxv3.common.synchronization [req-15de9b3c-3667-400c-a917-9d67305a4073 req-5230ff7b-a726-4583-8624-4ec51a6a0d87 service nova] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 856.122829] env[69274]: INFO networking_nsxv3.common.synchronization [req-15de9b3c-3667-400c-a917-9d67305a4073 req-5230ff7b-a726-4583-8624-4ec51a6a0d87 service nova] Enqueued Resource ID: 11d5345c-4085-4b3a-8c75-9dd8f317a26e with Priority: HIGHEST for action port [ 856.123444] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_rules [ 856.123599] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 856.123774] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11d5345c-4085-4b3a-8c75-9dd8f317a26e with Priority: HIGHEST for action port [ 856.124181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.124322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.124392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.124613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.124699] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.125729] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.125833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.126053] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-11d5345c-4085-4b3a-8c75-9dd8f317a26e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.126163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.126227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.126430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.126500] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11d5345c-4085-4b3a-8c75-9dd8f317a26e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.633380] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.633756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.634392] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11d5345c-4085-4b3a-8c75-9dd8f317a26e with status ACTIVE [ 856.634640] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.635555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.635658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.635902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.636010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.636359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.636359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.636478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.636552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.636632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.636830] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.636931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.637011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.637281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.637373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.637497] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11d5345c-4085-4b3a-8c75-9dd8f317a26e is going to be updated. [ 856.667204] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.667423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.667423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.668033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.668033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.668033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11d5345c-4085-4b3a-8c75-9dd8f317a26e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.874625] env[69274]: INFO networking_nsxv3.common.synchronization [req-d50d0235-19c3-4324-ad70-69c11fa19e47 req-097bf5b6-ce48-487d-a41c-d27fb5ac39c7 tempest-ServerAddressesNegativeTestJSON-1163460766 tempest-ServerAddressesNegativeTestJSON-1163460766-project-member] Enqueued Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_members [ 856.875106] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_members [ 856.875442] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.876385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.877178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.877504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.877669] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.877788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.877850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.878016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.878112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.878215] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.253566] env[69274]: INFO networking_nsxv3.common.synchronization [req-f0ddbc8f-3d6d-46c9-8153-67c323903114 req-658be993-858f-4428-a068-2ff1a8653a02 tempest-ListServerFiltersTestJSON-1290336512 tempest-ListServerFiltersTestJSON-1290336512-project-member] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 857.254955] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 857.257836] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.257836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.257836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.257836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.257836] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.257836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.257836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.257836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.257836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.257836] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.382892] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.382892] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.382892] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 already deleted. [ 857.382892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.637028] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 857.637028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.637028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.637028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.637028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.637028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.637028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.637028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.637028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.637028] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.758435] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.823184] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.826026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-324" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.826026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-324" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.826026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-324" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.826026] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.826026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.826026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.826026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.826026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.826559] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.826559] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.826680] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.826900] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.827382] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.827479] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.827653] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.852057] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.852279] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.852423] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.852633] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-324" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.855511] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-e1e1565f-92c7-4ab8-9205-5d0589777b7a taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.855511] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.855511] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.855511] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.855511] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1e1565f-92c7-4ab8-9205-5d0589777b7a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.140444] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.261497] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.356354] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.356653] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.356808] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.357127] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.357290] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.357490] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port e1e1565f-92c7-4ab8-9205-5d0589777b7a not found, creating... [ 858.357761] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.357986] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.358210] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.358557] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.358795] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.359158] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.359334] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.359458] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.359725] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.359918] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.360107] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: e1e1565f-92c7-4ab8-9205-5d0589777b7a is going to be created. [ 858.384291] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.384583] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.384768] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.385096] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.385351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.385639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.646428] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.764594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.764756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.764827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.765069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.765170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.765273] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 858.800673] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.800812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.800911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.801734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.802106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.814576] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 859.148185] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.148391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.148463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.148681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.148770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.148871] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be updated. [ 859.179310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.179310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.179457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.179567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.179835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.189281] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: IN_PROGRESS for 2s [ 859.272101] env[69274]: INFO networking_nsxv3.common.synchronization [None req-0ec642b4-446a-45d1-996f-235446459e20 None None] Enqueued Resource ID: 8abec7d0-3dfb-4b73-9390-9878d0c04332 with Priority: HIGHEST for action port [ 859.273854] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abec7d0-3dfb-4b73-9390-9878d0c04332 with Priority: HIGHEST for action port [ 859.273854] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8abec7d0-3dfb-4b73-9390-9878d0c04332 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.273854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8abec7d0-3dfb-4b73-9390-9878d0c04332" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.273854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8abec7d0-3dfb-4b73-9390-9878d0c04332" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.273854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8abec7d0-3dfb-4b73-9390-9878d0c04332" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.275014] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8abec7d0-3dfb-4b73-9390-9878d0c04332',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.459587] env[69274]: INFO networking_nsxv3.common.synchronization [req-d50d0235-19c3-4324-ad70-69c11fa19e47 req-8cc5954d-a4e7-41fc-a6fa-ceb0181ff495 service nova] Enqueued Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_rules [ 859.461107] env[69274]: INFO networking_nsxv3.common.synchronization [req-d50d0235-19c3-4324-ad70-69c11fa19e47 req-8cc5954d-a4e7-41fc-a6fa-ceb0181ff495 service nova] Enqueued Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_members [ 859.461107] env[69274]: INFO networking_nsxv3.common.synchronization [req-d50d0235-19c3-4324-ad70-69c11fa19e47 req-8cc5954d-a4e7-41fc-a6fa-ceb0181ff495 service nova] Enqueued Resource ID: e1e1565f-92c7-4ab8-9205-5d0589777b7a with Priority: HIGHEST for action port [ 859.461107] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_rules [ 859.461606] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_members [ 859.465135] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e1565f-92c7-4ab8-9205-5d0589777b7a with Priority: HIGHEST for action port [ 859.465135] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.465135] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.465135] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.465135] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.465135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.465840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.466074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.466300] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.467396] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1e1565f-92c7-4ab8-9205-5d0589777b7a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.467675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.468245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.468547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.468737] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1e1565f-92c7-4ab8-9205-5d0589777b7a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.777450] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8abec7d0-3dfb-4b73-9390-9878d0c04332 [ 859.777712] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.777852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.777924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.778170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.778264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.778359] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8abec7d0-3dfb-4b73-9390-9878d0c04332 already deleted. [ 859.778440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8abec7d0-3dfb-4b73-9390-9878d0c04332" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.971019] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.972419] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.972598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.973570] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1e1565f-92c7-4ab8-9205-5d0589777b7a with status ACTIVE [ 859.973570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.973570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.973712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.973797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.974343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.974343] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.974614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.974614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.974680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.974764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.974955] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.975103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.975147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.975476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.975476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.975538] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1e1565f-92c7-4ab8-9205-5d0589777b7a is going to be updated. [ 860.000039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.000694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.000694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.000694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.000694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.000915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1e1565f-92c7-4ab8-9205-5d0589777b7a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.473434] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.829104] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 860.830264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.976433] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.976626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.976626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.976804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.976909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.977046] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 is going to be created. [ 861.005678] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.005894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.005935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.006185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.006361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.017323] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 in Status: UNINITIALIZED for 2s [ 861.209472] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 861.209726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.209963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.210188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.210386] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.210516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.210582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.210727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.210788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.210869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.210963] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.230656] env[69274]: INFO networking_nsxv3.common.synchronization [None req-c2534ef2-b954-4236-893b-f2a5ffb1553c tempest-ServersTestBootFromVolume-1604377893 tempest-ServersTestBootFromVolume-1604377893-project-member] Enqueued Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_rules [ 861.231405] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_rules [ 861.231673] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.231798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.231864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.234278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.234387] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.390666] env[69274]: INFO networking_nsxv3.common.synchronization [None req-07c51673-e208-46de-a980-106748adfa72 tempest-ServersTestBootFromVolume-1604377893 tempest-ServersTestBootFromVolume-1604377893-project-member] Enqueued Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_rules [ 861.391294] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_rules [ 861.395852] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.395852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.673376] env[69274]: INFO networking_nsxv3.common.synchronization [None req-78181976-03fe-44ca-ba4d-25e713854274 None None] Enqueued Resource ID: 666ed2a7-7f47-4d91-802c-e02960bf7674 with Priority: HIGHEST for action port [ 861.673619] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 666ed2a7-7f47-4d91-802c-e02960bf7674 with Priority: HIGHEST for action port [ 861.674985] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-666ed2a7-7f47-4d91-802c-e02960bf7674 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.674985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-666ed2a7-7f47-4d91-802c-e02960bf7674" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.674985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-666ed2a7-7f47-4d91-802c-e02960bf7674" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.674985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-666ed2a7-7f47-4d91-802c-e02960bf7674" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.674985] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('666ed2a7-7f47-4d91-802c-e02960bf7674',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.714596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.714839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.715549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.715662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.715852] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.715960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.716041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.716230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.716336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.716453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.716944] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.717094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.717164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.717318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.717981] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.717981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.717981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.717981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.717981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.717981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.718376] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.759215] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.759362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.759948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.759948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.759948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.759948] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a already deleted. [ 861.759948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.760194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.760383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.760477] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.180832] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 666ed2a7-7f47-4d91-802c-e02960bf7674 [ 862.181219] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.181464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.181593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.181926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.182129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.182308] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:666ed2a7-7f47-4d91-802c-e02960bf7674 already deleted. [ 862.182484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-666ed2a7-7f47-4d91-802c-e02960bf7674" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.223105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa3cd7b-c562-43e1-96fe-99002d55eac1: rpc.has_security_group_logging(os_id): False [ 862.242909] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.245030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.245030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.245030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.270019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.270019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.270387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.270894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.271076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.271284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.275448] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.275448] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.275448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.275448] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be updated. [ 862.295388] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.295388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.295388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.295388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.295388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.295388] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a already deleted. [ 862.295704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.362141] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.362301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.362380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.362600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.362744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.378302] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: IN_PROGRESS for 2s [ 863.030167] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 in Status: SUCCESS [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.031541] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.031541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.031912] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.534726] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.534726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.534960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.535265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.535265] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.535557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.535557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.535689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.535999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.535999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.535999] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.536114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.536114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.536650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.536650] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.536650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.536650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.536650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.536895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.536895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.536895] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.016180] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-ff22d9e6-9ddf-49a6-8305-3d75876b9fc7 tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 864.016180] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 864.016180] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.016180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.016180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.016180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.016180] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.016180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.016180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.017728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.018020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.018918] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.044914] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 263ec48b-f6d4-4404-82b0-3777225d4fe1: rpc.has_security_group_logging(os_id): False [ 864.066078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.066078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.066078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.066078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.067195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.068051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.068311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.068520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.068765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.068933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.069112] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 is going to be created. [ 864.134578] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.138029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.138029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.138029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.138029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.151526] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 in Status: IN_PROGRESS for 2s [ 864.404953] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 864.404953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.526024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.526024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.526024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.526024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.526024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.526024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.526024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.526024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.528162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.528367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.528425] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 already deleted. [ 864.528504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.611755] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-aed2f6d1-f7ec-461b-b75c-144c103d343a tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 864.612396] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 864.612701] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.612824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.612893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.613471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.613654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.613803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.613908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.614118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.614215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.614350] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.119421] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.119727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.119727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.119868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.120226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.120503] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.120611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.120740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.120845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.120926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.121014] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 already deleted. [ 865.121095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.136711] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-c3415d7b-ba36-400e-9049-2033eb1c1ccb tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 865.136930] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 865.137336] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.137464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.137528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.137720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.137866] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.137965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.138095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.138263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.138367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.138461] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.644147] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.644147] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.644147] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 already deleted. [ 865.644147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.645151] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.645509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.645792] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.646211] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.646606] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.646911] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.647195] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.647659] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.647905] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.648697] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.648944] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.650016] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.650016] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.650016] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.650016] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.650016] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.671207] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.671418] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.671585] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.671783] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.672193] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-edcd0428-276c-4aca-939f-4b0a3856db79 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.672391] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.672596] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.673028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.673270] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edcd0428-276c-4aca-939f-4b0a3856db79',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.164261] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 in Status: SUCCESS [ 866.164598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.176374] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.176624] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.176762] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.177089] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.177258] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.177434] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port edcd0428-276c-4aca-939f-4b0a3856db79 not found, creating... [ 866.177725] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.177903] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.178049] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.178293] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.178448] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.178748] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.178915] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.179051] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.179271] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.179411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.179668] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: edcd0428-276c-4aca-939f-4b0a3856db79 is going to be created. [ 866.210811] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.211133] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.211365] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.211740] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.212153] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.212516] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.030730] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-8ba1769c-f764-47a3-9419-6253a26e1e49 service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 867.030913] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-8ba1769c-f764-47a3-9419-6253a26e1e49 service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 867.031199] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-8ba1769c-f764-47a3-9419-6253a26e1e49 service nova] Enqueued Resource ID: edcd0428-276c-4aca-939f-4b0a3856db79 with Priority: HIGHEST for action port [ 867.031697] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 867.035051] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 867.035051] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcd0428-276c-4aca-939f-4b0a3856db79 with Priority: HIGHEST for action port [ 867.035051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.035051] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.035051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.035051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.035051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.035740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.035740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.035740] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.036127] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-edcd0428-276c-4aca-939f-4b0a3856db79 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.036246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.036305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.036441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.036512] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edcd0428-276c-4aca-939f-4b0a3856db79',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.538602] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.538602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.538910] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.539929] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edcd0428-276c-4aca-939f-4b0a3856db79 with status ACTIVE [ 867.539929] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.540095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.540095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.540680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.540680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.540885] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.541139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.541139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.541320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.541440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.541638] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.541764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.541831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.542010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.542191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.542329] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edcd0428-276c-4aca-939f-4b0a3856db79 is going to be updated. [ 867.570728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.570728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.570728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.570728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.570728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.570728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edcd0428-276c-4aca-939f-4b0a3856db79" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.642650] env[69274]: INFO networking_nsxv3.common.synchronization [req-90ce19d5-254b-406f-b777-7dfb3730d992 req-8f2a4fbc-0e4f-45ae-a4dd-2495caba4a84 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_members [ 867.645538] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_members [ 867.649199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.649199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.649199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.649199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.649199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.649199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.649199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.649199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.649199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.649199] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.004380] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.004380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-265" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.005260] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-265" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.005260] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-265" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.005696] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.006576] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.006576] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.007384] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.007384] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.007384] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.007384] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.007497] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.007608] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.009124] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.009124] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.009124] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.034090] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.034090] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.034090] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.034090] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-265" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.034090] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.037386] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.037386] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.037386] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.037925] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87a1966d-3ba6-42c3-97cf-c77b81e06bbc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.047426] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.151203] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.151380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.151478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.151691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.151784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.152132] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.152243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.152294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.152568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.152568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.152726] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d already deleted. [ 868.152726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.509654] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.509790] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.509922] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.510305] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.510601] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.511223] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.511223] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.511223] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.511440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.511602] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.511663] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.511797] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.511917] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.512072] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.512288] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.512356] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.534926] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.535205] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.535376] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.535596] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.535957] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-ea3c372c-917b-420f-b829-2875e48e8e64 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.536183] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.536345] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.536716] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.536896] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3c372c-917b-420f-b829-2875e48e8e64',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.542058] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.542058] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.542575] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.542575] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.542638] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.543562] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 87a1966d-3ba6-42c3-97cf-c77b81e06bbc not found, creating... [ 868.543562] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.543562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.543562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.543781] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.543935] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.544348] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.544555] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.544716] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.545038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.545271] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.545331] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 87a1966d-3ba6-42c3-97cf-c77b81e06bbc is going to be created. [ 868.549043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.549158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.549219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.549667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.549775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.549886] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be created. [ 868.574938] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.575397] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.575642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.575934] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.576324] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.576642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.579825] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.580025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.580157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.580346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.580519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.600640] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: UNINITIALIZED for 2s [ 869.040244] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.040244] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.040244] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.040244] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.040546] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.040747] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port ea3c372c-917b-420f-b829-2875e48e8e64 not found, creating... [ 869.040991] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.041167] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.041292] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.041532] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.041673] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.041978] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.042345] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.042451] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.042680] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.044070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.044070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: ea3c372c-917b-420f-b829-2875e48e8e64 is going to be created. [ 869.065413] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.065633] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.065767] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.066068] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.066335] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.066573] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.382384] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-b5250cdc-8640-486a-abe9-983ff4874437 service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 869.382629] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-b5250cdc-8640-486a-abe9-983ff4874437 service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 869.382801] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-b5250cdc-8640-486a-abe9-983ff4874437 service nova] Enqueued Resource ID: 87a1966d-3ba6-42c3-97cf-c77b81e06bbc with Priority: HIGHEST for action port [ 869.384091] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 869.384091] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 869.384091] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87a1966d-3ba6-42c3-97cf-c77b81e06bbc with Priority: HIGHEST for action port [ 869.384091] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.384336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.384336] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.384404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.384564] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.384663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.384727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.384936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.385024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87a1966d-3ba6-42c3-97cf-c77b81e06bbc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.888237] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87a1966d-3ba6-42c3-97cf-c77b81e06bbc with status ACTIVE [ 869.888506] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.888645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.888718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.888949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.889058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.889246] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.889353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.889419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.889581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.889649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.889852] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.889960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.890120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.890182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.890277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.890369] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87a1966d-3ba6-42c3-97cf-c77b81e06bbc is going to be updated. [ 869.914473] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.914626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.914700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.914916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.915131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.915326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87a1966d-3ba6-42c3-97cf-c77b81e06bbc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.929115] env[69274]: INFO networking_nsxv3.common.synchronization [req-90ce19d5-254b-406f-b777-7dfb3730d992 req-5ee03bf2-26b3-4181-a429-b8179ec9e9cc service nova] Enqueued Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_rules [ 869.929310] env[69274]: INFO networking_nsxv3.common.synchronization [req-90ce19d5-254b-406f-b777-7dfb3730d992 req-5ee03bf2-26b3-4181-a429-b8179ec9e9cc service nova] Enqueued Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_members [ 869.929450] env[69274]: INFO networking_nsxv3.common.synchronization [req-90ce19d5-254b-406f-b777-7dfb3730d992 req-5ee03bf2-26b3-4181-a429-b8179ec9e9cc service nova] Enqueued Resource ID: ea3c372c-917b-420f-b829-2875e48e8e64 with Priority: HIGHEST for action port [ 869.929695] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_rules [ 869.929821] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_members [ 869.929927] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3c372c-917b-420f-b829-2875e48e8e64 with Priority: HIGHEST for action port [ 869.930596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.930720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.930784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.930982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.931122] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.932407] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.932531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.932617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.932825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.933049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.937116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.937116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.937116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.937116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.937116] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.937116] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea3c372c-917b-420f-b829-2875e48e8e64 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.937116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.937116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.938072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.938194] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3c372c-917b-420f-b829-2875e48e8e64',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.442461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.442461] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.442461] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea3c372c-917b-420f-b829-2875e48e8e64 with status ACTIVE [ 870.442461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.442461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.442461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.443266] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.443266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.443266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.443266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.443266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.443266] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea3c372c-917b-420f-b829-2875e48e8e64 is going to be updated. [ 870.454946] env[69274]: INFO networking_nsxv3.common.synchronization [req-efd2593d-2384-4948-b3e8-85809056eba0 req-bb0e8211-f465-4cc4-8184-3a08c9c335b8 tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 870.456669] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 870.457043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.457321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.457321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.457562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.457770] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.458882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.458975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.460013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.460162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.460334] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.480874] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.480874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.480874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.480874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.480874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.480874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea3c372c-917b-420f-b829-2875e48e8e64" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.518305] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-523 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.518305] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.518305] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.518305] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.518305] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.519737] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.519737] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.519737] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.519737] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.519737] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.520342] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.520570] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.520784] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.520990] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.521229] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.521512] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.544576] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.545104] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.547018] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.547018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.547018] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-f79f2019-7170-4582-9e20-dbc3d8d6fe19 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.547018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.547018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.547018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.547018] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f79f2019-7170-4582-9e20-dbc3d8d6fe19',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.586868] env[69274]: INFO networking_nsxv3.common.synchronization [req-9c7a4c11-8ba9-48a3-8515-a064ade9fad1 req-dd71a762-4139-4809-90a2-6ed97bc95510 tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 870.587401] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 870.587906] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.587906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.587906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.590891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.591183] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.591401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.591569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.591735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.591867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.592381] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.610890] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 870.611260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.611715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.612009] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.612283] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.612445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.612549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.612770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.612895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.613135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.613200] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.613968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.614210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.614451] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.614629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.614739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.614925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.615064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.615198] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.952832] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.964303] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.964556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.965715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.966035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.967300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.967730] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.967980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.967980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.971145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.971145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.971145] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 871.002434] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.002434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.002434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.002434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.002434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.014322] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 871.026076] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-704 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.027132] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.027132] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.027132] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.027132] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.027364] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.027757] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.028176] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.028331] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.028586] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.028739] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.028938] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.029021] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.029189] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.029334] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.029529] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.051368] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.051552] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 871.051696] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.051877] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-704" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.052328] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-1852cbd4-5529-4160-837a-a14f64df131f taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.052510] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.052633] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.052962] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.053135] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1852cbd4-5529-4160-837a-a14f64df131f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.056506] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.056614] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.056686] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.057032] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.057140] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.057273] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port f79f2019-7170-4582-9e20-dbc3d8d6fe19 not found, creating... [ 871.057534] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.057810] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.057810] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.058077] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.058179] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.058457] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.058628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.058752] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.059013] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.059113] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.059258] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: f79f2019-7170-4582-9e20-dbc3d8d6fe19 is going to be created. [ 871.082707] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.082820] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.082921] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.083427] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.083517] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.083704] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.098264] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.098425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.098509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.098695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.098782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.098975] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.099095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.099138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.099289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.099364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.099450] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be deleted. [ 871.117942] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.118170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.118410] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.134723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.134913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.134973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.135193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.135292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.135392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.456017] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.457025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.457025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.457025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.457025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.457025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d is going to be created. [ 871.481803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.481975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.482132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.482369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.482519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.493990] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d in Status: UNINITIALIZED for 2s [ 871.564235] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.564235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.564235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.564235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.564235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.564235] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 1852cbd4-5529-4160-837a-a14f64df131f not found, creating... [ 871.564235] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.564235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.564235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.564235] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.564561] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.564632] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.564806] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.564931] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.566480] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.566955] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.567072] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 1852cbd4-5529-4160-837a-a14f64df131f is going to be created. [ 871.589875] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.590135] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.590274] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.590570] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.590811] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.591064] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.625082] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.953585] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-26e1b650-8b98-4dcc-b69c-70cb0ccbc41c service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 871.953843] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-26e1b650-8b98-4dcc-b69c-70cb0ccbc41c service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 871.953968] env[69274]: INFO networking_nsxv3.common.synchronization [req-1973017e-e6a5-4c48-9e6c-33db79c13921 req-26e1b650-8b98-4dcc-b69c-70cb0ccbc41c service nova] Enqueued Resource ID: f79f2019-7170-4582-9e20-dbc3d8d6fe19 with Priority: HIGHEST for action port [ 871.954677] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 871.954731] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 871.954806] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f79f2019-7170-4582-9e20-dbc3d8d6fe19 with Priority: HIGHEST for action port [ 871.955964] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.957779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.959269] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.959391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.959612] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f79f2019-7170-4582-9e20-dbc3d8d6fe19 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.959724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.959797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.960038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.960125] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f79f2019-7170-4582-9e20-dbc3d8d6fe19',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.131203] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.131484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.131484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.131645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.131738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.131840] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 872.165131] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.165352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.165420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.165806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.165936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.177577] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 872.438470] env[69274]: INFO networking_nsxv3.common.synchronization [req-9c7a4c11-8ba9-48a3-8515-a064ade9fad1 req-aab8419b-5db7-43c9-8c8d-6aff4bc17018 service nova] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_rules [ 872.438773] env[69274]: INFO networking_nsxv3.common.synchronization [req-9c7a4c11-8ba9-48a3-8515-a064ade9fad1 req-aab8419b-5db7-43c9-8c8d-6aff4bc17018 service nova] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 872.440260] env[69274]: INFO networking_nsxv3.common.synchronization [req-9c7a4c11-8ba9-48a3-8515-a064ade9fad1 req-aab8419b-5db7-43c9-8c8d-6aff4bc17018 service nova] Enqueued Resource ID: 1852cbd4-5529-4160-837a-a14f64df131f with Priority: HIGHEST for action port [ 872.441096] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_rules [ 872.441322] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 872.441322] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1852cbd4-5529-4160-837a-a14f64df131f with Priority: HIGHEST for action port [ 872.441617] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.445030] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.445030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.445030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.445030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.445030] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.446806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1852cbd4-5529-4160-837a-a14f64df131f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.447208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.450251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.450529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.450757] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1852cbd4-5529-4160-837a-a14f64df131f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.461805] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f79f2019-7170-4582-9e20-dbc3d8d6fe19 with status ACTIVE [ 872.462114] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.463124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.463124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.463124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.463124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.463124] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.463124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.463124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.463530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.463530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.463627] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.463696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.463758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.464763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.464763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.464763] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f79f2019-7170-4582-9e20-dbc3d8d6fe19 is going to be updated. [ 872.487409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.487635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.487635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.487861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.488021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.488210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f79f2019-7170-4582-9e20-dbc3d8d6fe19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.954398] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.954688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.954778] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.959015] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1852cbd4-5529-4160-837a-a14f64df131f with status ACTIVE [ 872.959015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.959015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.959015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.959015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.959015] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1852cbd4-5529-4160-837a-a14f64df131f is going to be updated. [ 872.991767] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.991767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.992086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.992086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.992269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.992442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1852cbd4-5529-4160-837a-a14f64df131f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.025587] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 873.025813] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 deletion is rescheduled due to dependency. [ 873.025936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.458860] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.507029] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d in Status: SUCCESS [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.507029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.507029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.507029] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.961415] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.961682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.961682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.961875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.961977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.962130] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be created. [ 873.989357] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.989519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.989584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.989876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.990122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.002365] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: UNINITIALIZED for 2s [ 874.009961] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.188942] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 874.188942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.189061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.189390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.189668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.189892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.189930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.190215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.190330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.190471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.190675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.190833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.190961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.191141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.191524] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.191666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.191826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.191981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.192146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.192242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.192336] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.193340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.193427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.193556] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.193671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.193719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.193886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.193958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.195201] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.512694] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f601a42d-d49f-43f8-8ef0-10af2ee0fa8d: rpc.has_security_group_logging(os_id): False [ 874.535711] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.535879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.535879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.536048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.536146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.536445] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.536576] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.536663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.536904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.537029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.537132] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d is going to be created. [ 874.620829] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.621082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.621082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.621209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.621384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.634998] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d in Status: IN_PROGRESS for 2s [ 874.660917] env[69274]: INFO networking_nsxv3.common.synchronization [req-36f627ed-93ad-4ca0-8934-b2804f868994 req-eba27af8-4a15-4d79-aae5-fb06057b209e tempest-ServerAddressesNegativeTestJSON-1163460766 tempest-ServerAddressesNegativeTestJSON-1163460766-project-member] Enqueued Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_members [ 874.660917] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGHEST for action security_group_members [ 874.660917] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.660917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.661428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.661428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.661428] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.661643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.661763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.662038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.662193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.662319] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.696460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99b68d96-5b1d-4bdb-9748-7b151abff183: rpc.has_security_group_logging(os_id): False [ 874.698519] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.734658] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.734867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.734965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.735225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.735343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.735597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.735755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.737772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.738354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.738354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.739142] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.739142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.739142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.739142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.739368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.739461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.739577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.739677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.739946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.740054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.740174] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be created. [ 874.840817] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.841020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.841068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.841271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.841454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.852818] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 875.166848] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.167222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.167222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.171351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.171473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.171725] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.171911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.171911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.172217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.172217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.172349] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 is going to be updated. [ 875.202537] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.205563] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.205651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.205690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.206370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.206370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.213847] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 in Status: IN_PROGRESS for 2s [ 875.706063] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.706063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.706063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.706063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.706063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.706063] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 875.739444] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.739635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.739733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.740069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.740742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.752631] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 876.012800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 876.012935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.013408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.013408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.014301] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.014301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.014301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.014301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.014301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.014301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.014713] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.521035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.521035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.521035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.521035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.521035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.522012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.522012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.522012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.522012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.522012] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.649345] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d in Status: SUCCESS [ 876.650050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.873081] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 876.873317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.873515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.873749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.873845] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.025302] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 093f0a21-7741-4a8f-8410-d5b196f0f7d7: rpc.has_security_group_logging(os_id): False [ 877.043566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.043841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.043841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.044557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.044665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.044928] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.045325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.045325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.045325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.045469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.045654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.045760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.045934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.046029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.046149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.046351] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.046487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.046557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.046712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.046800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.046889] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be created. [ 877.093029] env[69274]: INFO networking_nsxv3.common.synchronization [req-352deb10-a9f3-47b3-88d7-11a08a48241e req-c86b2970-56cd-4361-9b54-dfed243d9e9d tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 877.093704] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 877.094035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.094179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.094283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.094498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.094655] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.094755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.094819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.094993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.095508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.095508] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.106600] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.106748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.106847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.107120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.107353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.121985] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 877.227707] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 in Status: SUCCESS [ 877.227707] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 deletion is rescheduled due to dependency. [ 877.227707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.376788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.376878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.598014] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.764780] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 877.765026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.765205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.765460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.765609] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.765726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.765824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.765935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.766051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.766137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.766234] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.104544] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.273104] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.273104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.273104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.273104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.273104] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.273104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.273666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.273666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.273666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.273666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.273666] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.273812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.273812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.273980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.274159] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.274327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.274434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.277648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.277648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.277648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.278307] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.607664] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.608476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.608571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.609295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.609295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.609295] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 878.658182] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.658182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.658182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.658182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.658182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.679055] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 878.784913] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99b68d96-5b1d-4bdb-9748-7b151abff183: rpc.has_security_group_logging(os_id): False [ 878.804090] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.804090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.804090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.804090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.804090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.804090] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.804423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.804423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.804423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.804521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.807335] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.807335] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.807335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.807335] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 878.866401] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.866558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.867523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.867523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.867523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.881629] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 879.141670] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 879.141911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.694956] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 880.695496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.899617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 880.899753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.899912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.900210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.900307] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.307121] env[69274]: INFO networking_nsxv3.common.synchronization [req-afc4a631-7b4c-4755-878c-e9addf7c0d53 req-7aa0cc09-991f-4fee-af1c-9269eb798b8c tempest-ServersV294TestFqdnHostnames-424206970 tempest-ServersV294TestFqdnHostnames-424206970-project-member] Enqueued Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_members [ 881.307755] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_members [ 881.308096] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.314111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.314111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.314111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.314111] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.314111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.314111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.314111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.314111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.314111] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.402877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.403069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.403171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.403383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.403570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.403660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.403729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.403900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.405088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.405278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.405386] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.813871] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-263 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.814276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-263" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.814276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-263" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.814623] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-263" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.814908] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.815130] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.815283] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.815592] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.815775] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.816082] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.816307] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.816507] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.816647] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.816769] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.816882] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.817041] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.818733] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.818851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.818927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.819125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.819216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.819413] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.819509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.819577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.819723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.819803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.819926] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 already deleted. [ 881.820059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.840468] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.840652] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 881.840798] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.840988] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-263" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.841321] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.841501] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.841628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.842012] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.842218] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9a323bc-7402-4a6e-84f0-f1eb52649d1b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.908069] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.911020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.911020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.911020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.911020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.911616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.911616] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.347026] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.347026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b9a323bc-7402-4a6e-84f0-f1eb52649d1b not found, creating... [ 882.347026] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.347026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.347741] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.347741] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.347741] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.347741] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.347880] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.347909] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b9a323bc-7402-4a6e-84f0-f1eb52649d1b is going to be created. [ 882.366249] env[69274]: INFO networking_nsxv3.common.synchronization [req-06e3096a-af8f-407e-bb9d-c385410965ab req-7bdcae66-31aa-4366-a687-04aadfe0fe98 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 882.366478] env[69274]: INFO networking_nsxv3.common.synchronization [req-06e3096a-af8f-407e-bb9d-c385410965ab req-7bdcae66-31aa-4366-a687-04aadfe0fe98 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 882.366764] env[69274]: INFO networking_nsxv3.common.synchronization [req-06e3096a-af8f-407e-bb9d-c385410965ab req-7bdcae66-31aa-4366-a687-04aadfe0fe98 tempest-SecurityGroupsTestJSON-1282415650 tempest-SecurityGroupsTestJSON-1282415650-project-member] Enqueued Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_members [ 882.367241] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGHEST for action security_group_members [ 882.367412] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGHEST for action security_group_members [ 882.367932] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGHEST for action security_group_members [ 882.367932] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.368132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.368132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.368235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.368392] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.368529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.368600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.368758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.368855] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.368939] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.369936] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.370096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.370165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.370312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.370775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.370882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.371394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.371394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.371394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.371394] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.372280] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.372355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.372419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.372569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.372712] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.372814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.372899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.373061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.373149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.373261] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.376058] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.376339] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.376546] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.376820] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.377088] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.377350] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.414191] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99b68d96-5b1d-4bdb-9748-7b151abff183: rpc.has_security_group_logging(os_id): False [ 882.439507] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.439635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.439733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.440095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.440221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.440426] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.440547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.440615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.440793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.440949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.441128] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.441247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.441312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.441476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.441594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.441788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.441885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.441947] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.442141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.442207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.442288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 882.604210] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.604401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.604401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.604677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.604833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.618892] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 882.874872] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.875245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.875245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.875317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.875345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.875559] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.875658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.875724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.875874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.875953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.876054] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be updated. [ 882.877270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.877386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.877454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.877610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.879193] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.879366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.908362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.908696] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.908823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.908887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.909222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.909311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.909410] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be updated. [ 882.910664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.910945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.912868] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.913068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.913504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.913753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.913953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.925395] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: IN_PROGRESS for 2s [ 882.944029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.945125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.945125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.945125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.945125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.948309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.952724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.952724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.952724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.952724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.952724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.952724] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e is going to be updated. [ 882.960525] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: IN_PROGRESS for 2s [ 883.007307] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.007307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.007307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.007307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.007307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.020918] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: IN_PROGRESS for 2s [ 883.170853] env[69274]: INFO networking_nsxv3.common.synchronization [req-afc4a631-7b4c-4755-878c-e9addf7c0d53 req-60be333a-2052-4296-9549-fa604c4e098c service nova] Enqueued Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_rules [ 883.170853] env[69274]: INFO networking_nsxv3.common.synchronization [req-afc4a631-7b4c-4755-878c-e9addf7c0d53 req-60be333a-2052-4296-9549-fa604c4e098c service nova] Enqueued Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_members [ 883.170954] env[69274]: INFO networking_nsxv3.common.synchronization [req-afc4a631-7b4c-4755-878c-e9addf7c0d53 req-60be333a-2052-4296-9549-fa604c4e098c service nova] Enqueued Resource ID: b9a323bc-7402-4a6e-84f0-f1eb52649d1b with Priority: HIGHEST for action port [ 883.172573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_rules [ 883.172573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_members [ 883.172573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9a323bc-7402-4a6e-84f0-f1eb52649d1b with Priority: HIGHEST for action port [ 883.172869] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.173466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.173466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.173568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.173691] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.175217] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.175463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.175575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.175920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.176645] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.176645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.176645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.176645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.176645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.176645] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.177581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.177740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.177842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.179912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.179912] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9a323bc-7402-4a6e-84f0-f1eb52649d1b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.646945] env[69274]: INFO networking_nsxv3.common.synchronization [req-131154ad-10a3-4a33-8570-24560c196fb3 req-62c0ba86-4b5a-4fab-ab41-a57ba1bd41a5 tempest-ImagesOneServerNegativeTestJSON-219129699 tempest-ImagesOneServerNegativeTestJSON-219129699-project-member] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 883.647560] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGHEST for action security_group_members [ 883.648615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.652021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.652021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.652021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.652021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.652021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.652021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.652021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.652021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.652021] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.653187] env[69274]: INFO networking_nsxv3.common.synchronization [req-594131a2-cefa-4c1c-b7f3-c4ad5474b67d req-0dabb356-e0d6-44e9-b1e5-6a25131ddcab tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 883.653953] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 883.654369] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.654621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.654773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.655182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.655427] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.655629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.655767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.656045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.656291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.656471] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.681368] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.681368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.682386] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.686023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9a323bc-7402-4a6e-84f0-f1eb52649d1b with status ACTIVE [ 883.686023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.686023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.686023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.686023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.686023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9a323bc-7402-4a6e-84f0-f1eb52649d1b is going to be updated. [ 883.759961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.760197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.760245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.760446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.760586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.760752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9a323bc-7402-4a6e-84f0-f1eb52649d1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.931413] env[69274]: INFO networking_nsxv3.common.synchronization [req-594131a2-cefa-4c1c-b7f3-c4ad5474b67d req-d708275e-0dcc-4518-8d16-c66ee0abc15a tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 883.932316] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 883.932418] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.932524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.154413] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.155195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.155195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.155195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.155195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.155381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.155432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.155461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.155650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.155770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.155878] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be updated. [ 884.158512] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.175352] env[69274]: INFO networking_nsxv3.common.synchronization [req-594131a2-cefa-4c1c-b7f3-c4ad5474b67d req-2acc8e7c-3954-4f3c-ae9f-32b9a02c501d tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 884.176154] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 884.176603] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.176735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.189450] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.196569] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.196771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.196771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.197324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.197324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.210203] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: IN_PROGRESS for 2s [ 884.636847] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 884.636847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.661914] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.692641] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.692641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.692641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.692641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.692641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.693031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 is going to be created. [ 884.731648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.731922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.732073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.732471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.734077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.750819] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 644d845b-e0e5-49b2-b970-585c199651e8 in Status: UNINITIALIZED for 2s [ 884.938658] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 in Status: SUCCESS [ 884.938990] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 deletion is rescheduled due to dependency. [ 884.939049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.985134] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cebac9fe-4ea0-40a1-a949-d690687274d0 in Status: SUCCESS [ 884.985635] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 deletion is rescheduled due to dependency. [ 884.985832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.033783] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e in Status: SUCCESS [ 885.033783] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e deletion is rescheduled due to dependency. [ 885.033783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.170894] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.170894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.170894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.170894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.170894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.170894] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 885.234866] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.235165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.235263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.235483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.235633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.255477] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 886.225944] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 in Status: SUCCESS [ 886.226345] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 deletion is rescheduled due to dependency. [ 886.226345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.767967] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 644d845b-e0e5-49b2-b970-585c199651e8 in Status: SUCCESS [ 886.768157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.768835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.769111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.770343] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.770343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.770343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.770343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.770343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.770343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.770707] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.275119] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.285790] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 887.286080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.286668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.286899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.287103] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.287236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.287307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.287983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.288191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.288225] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.777540] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 644d845b-e0e5-49b2-b970-585c199651e8: rpc.has_security_group_logging(os_id): False [ 887.793307] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.793307] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.793307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.793307] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 887.838181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.838181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.838181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.838181] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 is going to be created. [ 887.884269] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.884429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.884505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.884729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.884875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.898560] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 887.977469] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.977652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.977846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.977955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.978156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.000941] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 644d845b-e0e5-49b2-b970-585c199651e8 in Status: IN_PROGRESS for 2s [ 889.177650] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 889.178050] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 889.942586] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 889.942786] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 deletion is rescheduled due to dependency. [ 889.942899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.943075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.943303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.943538] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.943653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.943703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.943817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.943899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.943997] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.017131] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 644d845b-e0e5-49b2-b970-585c199651e8 in Status: SUCCESS [ 890.017131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.450267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.450267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.450714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.450714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.450714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.450827] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.450915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.451662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.451662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.451662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.451662] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 890.496381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.496381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.496381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.496381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.496381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.506683] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 892.497580] env[69274]: INFO networking_nsxv3.common.synchronization [req-0765f660-6d88-4853-ac94-9fe419e23f48 req-2c7441d0-fedb-45c1-bd8b-6fe468595995 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 892.498129] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 892.498675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.498838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.498933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.499247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.499421] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.499522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.500111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.500677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.500800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.500910] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.539940] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 892.539940] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 deletion is rescheduled due to dependency. [ 892.539940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.999136] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.999404] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.999543] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.999935] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.000277] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.000471] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.000617] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.000861] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.005875] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.006326] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.006972] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.007169] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.007302] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.009622] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.009773] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.009988] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.011958] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.013331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.013426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.013673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.013779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.014021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.014262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.014262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.014403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.014510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.014587] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 already deleted. [ 893.014729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.038968] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.039245] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.039419] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.039668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.040142] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-a6a9f039-91c4-4ba0-8098-82c48986a304 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.040402] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.040660] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.041143] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.041333] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6a9f039-91c4-4ba0-8098-82c48986a304',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.347528] env[69274]: INFO networking_nsxv3.common.synchronization [req-287d6dc9-5212-4339-a426-2b5e08b005f6 req-5ad276e7-27b7-4e9a-8881-0641cc554511 tempest-ListServerFiltersTestJSON-1290336512 tempest-ListServerFiltersTestJSON-1290336512-project-member] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 893.348306] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 893.348800] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.349286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.349513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.351667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.351667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.351667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.351667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.351667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.351667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.351667] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.544210] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.544649] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.544649] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.544795] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.544951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.545213] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port a6a9f039-91c4-4ba0-8098-82c48986a304 not found, creating... [ 893.545492] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.545658] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.545817] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.546034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.546188] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.546527] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.546813] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.546982] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.547268] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.547541] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.547758] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: a6a9f039-91c4-4ba0-8098-82c48986a304 is going to be created. [ 893.574100] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.574352] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.574485] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.574772] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.575025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.575275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.854752] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.357364] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.594040] env[69274]: INFO networking_nsxv3.common.synchronization [req-0765f660-6d88-4853-ac94-9fe419e23f48 req-175dfea7-3918-42dd-bd93-5f6e6045dc6a service nova] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_rules [ 894.594457] env[69274]: INFO networking_nsxv3.common.synchronization [req-0765f660-6d88-4853-ac94-9fe419e23f48 req-175dfea7-3918-42dd-bd93-5f6e6045dc6a service nova] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 894.594457] env[69274]: INFO networking_nsxv3.common.synchronization [req-0765f660-6d88-4853-ac94-9fe419e23f48 req-175dfea7-3918-42dd-bd93-5f6e6045dc6a service nova] Enqueued Resource ID: a6a9f039-91c4-4ba0-8098-82c48986a304 with Priority: HIGHEST for action port [ 894.594967] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_rules [ 894.595138] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 894.595306] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a9f039-91c4-4ba0-8098-82c48986a304 with Priority: HIGHEST for action port [ 894.595668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.595799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.595866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.596180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.596296] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.597557] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.597680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.597680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.597919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.602419] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.602419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.602419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.602419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.602419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.602590] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.606963] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6a9f039-91c4-4ba0-8098-82c48986a304 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.606963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.606963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.606963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.606963] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6a9f039-91c4-4ba0-8098-82c48986a304',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.863788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.863975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.864131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.864409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.864623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.864623] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 894.923867] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.924066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.924137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.924353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.925152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.939989] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 895.106784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.106926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.107149] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.109136] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6a9f039-91c4-4ba0-8098-82c48986a304 with status ACTIVE [ 895.109324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.109443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.109511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.109711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.109801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.109961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.110073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.110171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.110364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.110447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.110630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.110725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.110786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.110934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.111035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.111083] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6a9f039-91c4-4ba0-8098-82c48986a304 is going to be updated. [ 895.134030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.134331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.134439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.134745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.134943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.135159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6a9f039-91c4-4ba0-8098-82c48986a304" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.612862] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.116961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.117216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.117290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.117483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.117577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.117680] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be created. [ 896.148442] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.148651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.148651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.148868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.149042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.160587] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: UNINITIALIZED for 2s [ 896.948829] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 896.949200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.299814] env[69274]: INFO networking_nsxv3.common.synchronization [None req-f9f27abc-d1e0-44b9-9065-080414b9d2d7 None None] Enqueued Resource ID: 64aea457-9e78-4ec7-84e6-50972db8bf19 with Priority: HIGHEST for action port [ 897.300857] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64aea457-9e78-4ec7-84e6-50972db8bf19 with Priority: HIGHEST for action port [ 897.303600] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-64aea457-9e78-4ec7-84e6-50972db8bf19 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.304410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64aea457-9e78-4ec7-84e6-50972db8bf19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.304410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64aea457-9e78-4ec7-84e6-50972db8bf19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.304410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64aea457-9e78-4ec7-84e6-50972db8bf19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.304410] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64aea457-9e78-4ec7-84e6-50972db8bf19',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.810788] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64aea457-9e78-4ec7-84e6-50972db8bf19 [ 897.810788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.810788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.810788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.811117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.811117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.811117] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64aea457-9e78-4ec7-84e6-50972db8bf19 already deleted. [ 897.811230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64aea457-9e78-4ec7-84e6-50972db8bf19" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.172572] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: UNINITIALIZED for 4s [ 898.176172] env[69274]: INFO networking_nsxv3.common.synchronization [req-26f4a060-8b54-4e32-8ad9-eb617e837d6d req-986d10a6-d6ce-427d-9513-abcea7150ebd tempest-SecurityGroupRulesTestJSON-2066638982 tempest-SecurityGroupRulesTestJSON-2066638982-project-member] Enqueued Resource ID: 3d7e959f-8746-44f2-b0d0-09ce7b490529 with Priority: HIGHEST for action security_group_rules [ 898.176708] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7e959f-8746-44f2-b0d0-09ce7b490529 with Priority: HIGHEST for action security_group_rules [ 898.177031] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d7e959f-8746-44f2-b0d0-09ce7b490529 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.177147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d7e959f-8746-44f2-b0d0-09ce7b490529" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.177213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d7e959f-8746-44f2-b0d0-09ce7b490529" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.177473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d7e959f-8746-44f2-b0d0-09ce7b490529" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.177559] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d7e959f-8746-44f2-b0d0-09ce7b490529',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.652286] env[69274]: INFO networking_nsxv3.common.synchronization [req-fd99f1a9-30a8-4ba8-a524-34673b8ae430 req-44e05cd1-5436-4698-b7f1-1a35d1e79c89 tempest-SecurityGroupRulesTestJSON-2066638982 tempest-SecurityGroupRulesTestJSON-2066638982-project-member] Enqueued Resource ID: b6a565ac-3d97-460b-b986-a98f619dd407 with Priority: HIGHEST for action security_group_rules [ 898.652896] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a565ac-3d97-460b-b986-a98f619dd407 with Priority: HIGHEST for action security_group_rules [ 898.657393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a565ac-3d97-460b-b986-a98f619dd407 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.657571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a565ac-3d97-460b-b986-a98f619dd407" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.657611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a565ac-3d97-460b-b986-a98f619dd407" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.657883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a565ac-3d97-460b-b986-a98f619dd407" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.657980] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a565ac-3d97-460b-b986-a98f619dd407',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.704402] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.705322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.705322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.705322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.705322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.708269] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d7e959f-8746-44f2-b0d0-09ce7b490529 already deleted. [ 898.708565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d7e959f-8746-44f2-b0d0-09ce7b490529" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.764672] env[69274]: INFO networking_nsxv3.common.synchronization [req-55f15956-47e4-43d5-8679-66ff0bc26f59 req-f6742527-bd39-435a-a984-afa64b387f1e tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 898.765317] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 898.765641] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.765762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.766771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.770023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.770023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.770023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.770023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.770023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.770023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.770023] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.185643] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.186145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.186145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.186145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.187036] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a565ac-3d97-460b-b986-a98f619dd407 already deleted. [ 899.187036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a565ac-3d97-460b-b986-a98f619dd407" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.274539] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.304597] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.305354] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.305354] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.305354] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.305589] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.305756] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.305884] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.306143] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.306307] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.306539] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.306664] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.307027] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.307027] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.308655] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.308655] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.308655] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.333852] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.333852] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.333852] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.333852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.334507] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.334507] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.334718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.336805] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.336805] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.476623] env[69274]: INFO networking_nsxv3.common.synchronization [req-be23a67d-3a95-42f2-9cff-449f7f22b0b8 req-450d4c23-c1f7-4f29-a43a-a51384da34c2 tempest-SecurityGroupRulesTestJSON-2066638982 tempest-SecurityGroupRulesTestJSON-2066638982-project-member] Enqueued Resource ID: 8539b6be-0b6d-4aec-81a7-b01f94fd6dd8 with Priority: HIGHEST for action security_group_rules [ 899.477531] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8539b6be-0b6d-4aec-81a7-b01f94fd6dd8 with Priority: HIGHEST for action security_group_rules [ 899.478404] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8539b6be-0b6d-4aec-81a7-b01f94fd6dd8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.478796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8539b6be-0b6d-4aec-81a7-b01f94fd6dd8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.479058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8539b6be-0b6d-4aec-81a7-b01f94fd6dd8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.480230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8539b6be-0b6d-4aec-81a7-b01f94fd6dd8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.480446] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8539b6be-0b6d-4aec-81a7-b01f94fd6dd8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.778561] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.839089] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.840518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.840518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.840518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.840518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.840518] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 not found, creating... [ 899.840518] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.840884] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.840884] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.840941] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.841218] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.841420] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.841654] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.841714] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.841927] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.842146] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.842352] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 is going to be created. [ 899.862633] env[69274]: INFO networking_nsxv3.common.synchronization [None req-fe122282-44f5-4aec-8bb0-f4aa8496a260 None None] Enqueued Resource ID: 9659bb2f-c877-4288-a2aa-9308df2206ce with Priority: HIGHEST for action port [ 899.863392] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9659bb2f-c877-4288-a2aa-9308df2206ce with Priority: HIGHEST for action port [ 899.863605] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-9659bb2f-c877-4288-a2aa-9308df2206ce taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.863767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9659bb2f-c877-4288-a2aa-9308df2206ce" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.863850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9659bb2f-c877-4288-a2aa-9308df2206ce" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.864731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9659bb2f-c877-4288-a2aa-9308df2206ce" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.864822] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9659bb2f-c877-4288-a2aa-9308df2206ce',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.870314] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.870314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.870314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.870314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.870314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.870314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.947184] env[69274]: INFO networking_nsxv3.common.synchronization [req-614c0eb8-ba45-46c9-8f26-3280f2875f7a req-6caeedbe-f430-4150-bf12-04845ebb5aed tempest-SecurityGroupRulesTestJSON-2066638982 tempest-SecurityGroupRulesTestJSON-2066638982-project-member] Enqueued Resource ID: 6a6a1234-88ba-4874-90ef-90f64b27f63a with Priority: HIGHEST for action security_group_rules [ 899.947758] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a6a1234-88ba-4874-90ef-90f64b27f63a with Priority: HIGHEST for action security_group_rules [ 899.948086] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a6a1234-88ba-4874-90ef-90f64b27f63a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.948382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a6a1234-88ba-4874-90ef-90f64b27f63a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.948382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a6a1234-88ba-4874-90ef-90f64b27f63a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.948531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a6a1234-88ba-4874-90ef-90f64b27f63a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.948615] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a6a1234-88ba-4874-90ef-90f64b27f63a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.013705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.013705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.013705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.014099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.014099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.014099] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8539b6be-0b6d-4aec-81a7-b01f94fd6dd8 already deleted. [ 900.014208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8539b6be-0b6d-4aec-81a7-b01f94fd6dd8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.184147] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: SUCCESS [ 900.184375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.184597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.185736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.185736] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.185736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.185736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.185736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.185736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.185736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.185736] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.281018] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.281294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.281421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.281749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.281907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.282083] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 900.340274] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.340377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.340415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.340747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.340747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.356777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 900.371421] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9659bb2f-c877-4288-a2aa-9308df2206ce [ 900.371512] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.371651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.371721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.372082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.372082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.372202] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9659bb2f-c877-4288-a2aa-9308df2206ce already deleted. [ 900.372260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9659bb2f-c877-4288-a2aa-9308df2206ce" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.471662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.471662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.471662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.472429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.472897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.472897] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a6a1234-88ba-4874-90ef-90f64b27f63a already deleted. [ 900.472897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a6a1234-88ba-4874-90ef-90f64b27f63a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.688897] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.689078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.689154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.689385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.689561] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.689666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.689729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.689885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.689974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.690072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.690256] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.690357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.690422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.690568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.690705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.690797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.690859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.690995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.691087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.691168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.691256] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.705681] env[69274]: INFO networking_nsxv3.common.synchronization [req-55f15956-47e4-43d5-8679-66ff0bc26f59 req-c6c75582-58b4-49f9-85c4-a249e44e0369 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 900.705810] env[69274]: INFO networking_nsxv3.common.synchronization [req-55f15956-47e4-43d5-8679-66ff0bc26f59 req-c6c75582-58b4-49f9-85c4-a249e44e0369 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 900.706676] env[69274]: INFO networking_nsxv3.common.synchronization [req-55f15956-47e4-43d5-8679-66ff0bc26f59 req-c6c75582-58b4-49f9-85c4-a249e44e0369 service nova] Enqueued Resource ID: 16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 with Priority: HIGHEST for action port [ 900.706834] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 900.706984] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 900.707131] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 with Priority: HIGHEST for action port [ 900.707312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.713518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.713518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.713518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.713518] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.713518] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.713518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.713518] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.713518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.713518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.713518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.713518] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.751415] env[69274]: INFO networking_nsxv3.common.synchronization [req-f9a656a9-3d15-4602-9352-f54888e607b7 req-aa0cadf3-1fd9-4227-b6d5-77e2cb0b8f99 tempest-SecurityGroupRulesTestJSON-2066638982 tempest-SecurityGroupRulesTestJSON-2066638982-project-member] Enqueued Resource ID: 319940e7-fa98-42fa-a5da-31812668b8a9 with Priority: HIGHEST for action security_group_rules [ 900.752081] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 319940e7-fa98-42fa-a5da-31812668b8a9 with Priority: HIGHEST for action security_group_rules [ 900.752455] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-319940e7-fa98-42fa-a5da-31812668b8a9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.752638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.752680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.752951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.753068] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('319940e7-fa98-42fa-a5da-31812668b8a9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.012171] env[69274]: INFO networking_nsxv3.common.synchronization [req-fe1be9c0-5f8a-451e-b024-ff7d03e07395 req-aac40181-460e-46fe-9cef-f52a9a8d3115 tempest-SecurityGroupRulesTestJSON-2066638982 tempest-SecurityGroupRulesTestJSON-2066638982-project-member] Enqueued Resource ID: 319940e7-fa98-42fa-a5da-31812668b8a9 with Priority: HIGHEST for action security_group_rules [ 901.013447] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 319940e7-fa98-42fa-a5da-31812668b8a9 with Priority: HIGHEST for action security_group_rules [ 901.013607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-319940e7-fa98-42fa-a5da-31812668b8a9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.013705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.195036] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 425a6912-a0c6-4fca-8187-80a58f8e7880: rpc.has_security_group_logging(os_id): False [ 901.211548] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.211548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.211548] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 with status ACTIVE [ 901.211752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.211891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.211959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.212342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.212545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.212659] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.212792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.212835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.212980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.213072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.213356] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.213356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.213489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.213551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.213631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.213721] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22 is going to be updated. [ 901.229012] env[69274]: INFO networking_nsxv3.common.synchronization [req-02474aa1-e219-4453-8a11-8f6e13905189 req-80f159af-effa-4aba-b969-b5ac93d4799a tempest-SecurityGroupRulesTestJSON-2066638982 tempest-SecurityGroupRulesTestJSON-2066638982-project-member] Enqueued Resource ID: 319940e7-fa98-42fa-a5da-31812668b8a9 with Priority: HIGHEST for action security_group_rules [ 901.229979] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 319940e7-fa98-42fa-a5da-31812668b8a9 with Priority: HIGHEST for action security_group_rules [ 901.230716] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-319940e7-fa98-42fa-a5da-31812668b8a9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.230716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.234680] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.234680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.234680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.234680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.234680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.234680] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.234680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.235332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.235847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.236143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.236612] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.236944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.237194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.237592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.237868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.238367] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.238723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.239534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.239534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.239833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.243064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be created. [ 901.257027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.257027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.257027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.257027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.257027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.257027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16bfb3ff-4a5a-43d3-8a25-0b46dcff5a22" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.296619] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.296835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.296835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.297080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.297408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.297541] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 319940e7-fa98-42fa-a5da-31812668b8a9 already deleted. [ 901.297649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.297827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.298036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.298089] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('319940e7-fa98-42fa-a5da-31812668b8a9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.344513] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.345276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.345276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.345450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.345610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.374020] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: IN_PROGRESS for 2s [ 901.826163] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.826357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.826434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.826663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.826763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.826865] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 319940e7-fa98-42fa-a5da-31812668b8a9 already deleted. [ 901.826951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.827126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.827280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.827369] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('319940e7-fa98-42fa-a5da-31812668b8a9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.347726] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.347726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.347726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.348128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.348128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.348184] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 319940e7-fa98-42fa-a5da-31812668b8a9 already deleted. [ 902.348227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-319940e7-fa98-42fa-a5da-31812668b8a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.367313] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 902.367662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.367843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.368068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.368270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.368389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.368454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.368657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.368735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.368796] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.871390] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.897651] env[69274]: INFO networking_nsxv3.common.synchronization [req-3c8614a2-41ed-439b-9c3d-43387acc5523 req-c61e3aa3-4a40-4d00-a8fc-cafba06694e0 tempest-ServersWithSpecificFlavorTestJSON-7327972 tempest-ServersWithSpecificFlavorTestJSON-7327972-project-member] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 902.898269] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGHEST for action security_group_members [ 902.898633] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.898784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.898860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.901179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.901858] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.901858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.901858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.902095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.902150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.902319] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.374626] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.390029] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: SUCCESS [ 903.390029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.405220] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.405387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.405479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.405757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.427125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.427394] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.427516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.427582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.427799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.427930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.428129] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be updated. [ 903.455097] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.455932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.455932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.455932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.456119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.466032] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: IN_PROGRESS for 2s [ 903.880892] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.880892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.880892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.880892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.880892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.880892] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 903.948131] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.950201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.950201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.950612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.950868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.967155] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 904.164864] env[69274]: INFO networking_nsxv3.common.synchronization [req-deec4d07-a92a-4294-96a5-0cf1381f77e9 req-606dad7e-3dd3-490e-a221-45a4def27e7a tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 904.170880] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 904.170880] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.170880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.170880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.170880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.170880] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.170880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.170880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.170880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.170880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.170880] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.675530] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.675967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.675967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.676437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.676669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.676926] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.677087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.677157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.677439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.677439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.677606] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 904.708424] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.708699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.708813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.709198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.709445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.722241] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 905.479368] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a in Status: SUCCESS [ 905.479641] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a deletion is rescheduled due to dependency. [ 905.482645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.515604] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.515823] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.515970] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.517031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.517031] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.517031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.517031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.517337] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.517337] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.517457] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.518014] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.518014] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.518014] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.518014] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.518014] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.518273] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.539860] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.540100] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 905.540308] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.540536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.540979] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.541222] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.541367] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.541730] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.541913] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.982151] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 905.982420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.982553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.982820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.983065] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.983214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.983394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.983660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.983785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.983942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.984122] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.045052] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.045307] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.045562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.045995] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.046298] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.046782] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c not found, creating... [ 906.050922] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.051407] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.051508] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.051744] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.052021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.052472] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.052690] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.052845] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.053644] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.053817] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.053981] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c is going to be created. [ 906.081735] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.081977] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.082123] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.082517] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.082786] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.083052] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.486803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.487080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.487080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.487264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.487435] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.487542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.487606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.487926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.487926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.487926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.488137] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.488219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.488219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.488362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.488504] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.488588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.488648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.488785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.488864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.488945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.489047] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.685678] env[69274]: INFO networking_nsxv3.common.synchronization [req-a9bc9a4e-1624-4333-b95c-d338bfd861c8 req-d6042964-b47a-46c0-87e3-34c9aec3c037 tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 906.686712] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 906.687101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.687297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.687411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.687695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.688172] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.688312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.688420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.688703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.688823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.688983] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.736808] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 906.736808] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 deletion is rescheduled due to dependency. [ 906.736808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.994275] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 907.015391] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.015657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.015657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.015812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.039773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.040076] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.040212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.040287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.040516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.040607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.040796] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.040900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.040981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.041122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.041198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.041386] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.041512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.041579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.041723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.041801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.041887] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 907.048893] env[69274]: INFO networking_nsxv3.common.synchronization [req-deec4d07-a92a-4294-96a5-0cf1381f77e9 req-d1539e4b-95c6-467f-8dfa-bc450a386e1d service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 907.049647] env[69274]: INFO networking_nsxv3.common.synchronization [req-deec4d07-a92a-4294-96a5-0cf1381f77e9 req-d1539e4b-95c6-467f-8dfa-bc450a386e1d service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 907.049831] env[69274]: INFO networking_nsxv3.common.synchronization [req-deec4d07-a92a-4294-96a5-0cf1381f77e9 req-d1539e4b-95c6-467f-8dfa-bc450a386e1d service nova] Enqueued Resource ID: 1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c with Priority: HIGHEST for action port [ 907.050083] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 907.050235] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 907.050318] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c with Priority: HIGHEST for action port [ 907.050873] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.051204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.051279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.051493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.051580] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.056022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.056022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.056022] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.056022] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.056022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.056022] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.117721] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.117882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.117946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.118179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.118327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.139435] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 907.193455] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.554357] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.554357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.558241] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c with status ACTIVE [ 907.558473] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.558619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.558678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.558913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.559016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.559202] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.559305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.559369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.559523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.559601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.559775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.559888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.559946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.560756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.560756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.560756] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c is going to be updated. [ 907.561424] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.582887] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.583236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.583340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.583583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.583736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.583905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b7024f0-f5b3-4ed8-a9d1-f0a74be2cf5c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.694065] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.066628] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.198484] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.198810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.198810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.198943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.198996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.199121] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 908.232050] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.236259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.236369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.236732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.236888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.265475] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 908.570823] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.570823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.570823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.570823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.570823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.570823] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 908.650719] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.650719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.650719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.650719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.650719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.666545] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 908.668378] env[69274]: INFO networking_nsxv3.common.synchronization [None req-8397b0e3-c065-4299-87ca-42b2d2268540 None None] Enqueued Resource ID: 9d20beb3-2750-4363-b442-1c16f5689f7c with Priority: HIGHEST for action port [ 908.669760] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d20beb3-2750-4363-b442-1c16f5689f7c with Priority: HIGHEST for action port [ 908.670489] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d20beb3-2750-4363-b442-1c16f5689f7c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.671079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d20beb3-2750-4363-b442-1c16f5689f7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.671160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d20beb3-2750-4363-b442-1c16f5689f7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.671948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d20beb3-2750-4363-b442-1c16f5689f7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.671948] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d20beb3-2750-4363-b442-1c16f5689f7c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.155135] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 909.155415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.174720] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d20beb3-2750-4363-b442-1c16f5689f7c [ 909.175769] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.175769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.175769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.175769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.175769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.175769] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d20beb3-2750-4363-b442-1c16f5689f7c already deleted. [ 909.175769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d20beb3-2750-4363-b442-1c16f5689f7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.278410] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 910.278767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.681033] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.681033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.681033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.681033] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.739297] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b9e42898-7bbf-4724-9fff-eca3a256c622 None None] Enqueued Resource ID: e3a3cf03-a13d-4520-b8f3-2ecc882d3df5 with Priority: HIGHEST for action port [ 910.739297] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3a3cf03-a13d-4520-b8f3-2ecc882d3df5 with Priority: HIGHEST for action port [ 910.739297] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3a3cf03-a13d-4520-b8f3-2ecc882d3df5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.739297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3a3cf03-a13d-4520-b8f3-2ecc882d3df5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.739297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3a3cf03-a13d-4520-b8f3-2ecc882d3df5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.739297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3a3cf03-a13d-4520-b8f3-2ecc882d3df5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.739297] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3a3cf03-a13d-4520-b8f3-2ecc882d3df5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.752163] env[69274]: INFO networking_nsxv3.common.synchronization [None req-1be3b258-c358-4db9-80bb-88c92dd95735 None None] Enqueued Resource ID: 5f7f9b3b-0135-4581-a2b6-5898788d0383 with Priority: HIGHEST for action port [ 910.752163] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f7f9b3b-0135-4581-a2b6-5898788d0383 with Priority: HIGHEST for action port [ 910.752690] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f7f9b3b-0135-4581-a2b6-5898788d0383 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.752983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f7f9b3b-0135-4581-a2b6-5898788d0383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.752983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f7f9b3b-0135-4581-a2b6-5898788d0383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.753162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f7f9b3b-0135-4581-a2b6-5898788d0383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.753210] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f7f9b3b-0135-4581-a2b6-5898788d0383',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.868149] env[69274]: INFO networking_nsxv3.common.synchronization [None req-baa5e8d2-c50c-4d65-be21-714d00e7ca29 tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 910.868310] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 910.868485] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.868608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.868676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.868929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.869099] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.044816] env[69274]: INFO networking_nsxv3.common.synchronization [None req-25b13cb2-9df4-4484-9dc3-8baf5c46d93e tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 911.046238] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 911.046238] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.046238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.187026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.187026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.187026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.187026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.187026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.187672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.187672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.187672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.187672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.187672] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.246024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3a3cf03-a13d-4520-b8f3-2ecc882d3df5 [ 911.246024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.246024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.246024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.246024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.246024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.246024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3a3cf03-a13d-4520-b8f3-2ecc882d3df5 already deleted. [ 911.246024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3a3cf03-a13d-4520-b8f3-2ecc882d3df5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.255454] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f7f9b3b-0135-4581-a2b6-5898788d0383 [ 911.255810] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.255961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.256058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.256296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.256401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.256520] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f7f9b3b-0135-4581-a2b6-5898788d0383 already deleted. [ 911.256641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f7f9b3b-0135-4581-a2b6-5898788d0383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.397967] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.398429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.398429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.398573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.398866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.398866] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb already deleted. [ 911.399023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.399296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.399764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.399764] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.689458] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1ed1d16-c48a-4859-8659-45390ac1d1a8: rpc.has_security_group_logging(os_id): False [ 911.710210] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.711187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.711187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.711187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.711187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.711187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.711187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.711187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.711492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.711492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.711637] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.711702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.711742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.712406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.712406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.717606] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.717806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.717930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.718164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.718298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.718430] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 911.791538] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.791664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.791730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.791924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.792069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.809327] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 911.922984] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.923225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.923292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.923489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.923599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.923711] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb already deleted. [ 911.923813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.352269] env[69274]: INFO networking_nsxv3.common.synchronization [None req-5561b46f-9462-4724-90ce-8081bafa1f8b None None] Enqueued Resource ID: dddc5053-a12d-401a-8c15-f99a7d662900 with Priority: HIGHEST for action port [ 913.354483] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dddc5053-a12d-401a-8c15-f99a7d662900 with Priority: HIGHEST for action port [ 913.355105] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-dddc5053-a12d-401a-8c15-f99a7d662900 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.356194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dddc5053-a12d-401a-8c15-f99a7d662900" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.356383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dddc5053-a12d-401a-8c15-f99a7d662900" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.356727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dddc5053-a12d-401a-8c15-f99a7d662900" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.357358] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dddc5053-a12d-401a-8c15-f99a7d662900',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.825483] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 913.825483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.863045] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dddc5053-a12d-401a-8c15-f99a7d662900 [ 913.866187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.866187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.866187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.866187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.866491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.866491] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dddc5053-a12d-401a-8c15-f99a7d662900 already deleted. [ 913.866614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dddc5053-a12d-401a-8c15-f99a7d662900" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.139382] env[69274]: INFO networking_nsxv3.common.synchronization [req-364e0acf-40e7-4e62-a31a-0e5e34fc6b8f req-1646c9f5-6841-465f-9c34-376685ec89a8 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 914.140027] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 914.140380] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.140522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.140587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.140791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.140940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.141049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.141108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.141249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.141331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.141431] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.646296] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.146642] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.648635] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.649100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.649100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.649100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.649260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.649308] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 915.694131] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.694286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.694348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.694634] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.694721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.709417] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 915.813199] env[69274]: INFO networking_nsxv3.common.synchronization [req-b56008d2-4f18-4809-976a-1bb8750bcd85 req-6805eb73-cc1f-448c-b2f5-16589ff6eef9 tempest-ServersTestBootFromVolume-1604377893 tempest-ServersTestBootFromVolume-1604377893-project-member] Enqueued Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_members [ 915.813782] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_members [ 915.814117] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.815057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.815057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.815057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.815057] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.815057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.815057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.815057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.815354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.815354] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.319473] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.319625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.319625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.319823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.319935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.320181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.320452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.320452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.320563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.320616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.320837] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a already deleted. [ 916.320837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.333168] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.333532] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-12" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.334124] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-12" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.334410] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-12" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.334895] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.335182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.335414] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.335994] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.336290] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.336800] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.337633] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.338144] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.338479] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.339010] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.339235] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.339510] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.373031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.373031] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 916.373322] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.373387] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-12" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.374545] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-f429b984-941e-406a-a4c3-0746b00aecf2 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.374545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.374545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.374545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.374790] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f429b984-941e-406a-a4c3-0746b00aecf2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.878868] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.879186] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.879394] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.879771] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.879951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.880182] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port f429b984-941e-406a-a4c3-0746b00aecf2 not found, creating... [ 916.880542] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.880782] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.880958] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.881298] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.881509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.881890] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.882103] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.882278] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.882655] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.882819] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.882974] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: f429b984-941e-406a-a4c3-0746b00aecf2 is going to be created. [ 916.911241] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.911241] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.911241] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.911241] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.911241] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.911241] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.721790] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 917.722164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.828057] env[69274]: INFO networking_nsxv3.common.synchronization [req-b56008d2-4f18-4809-976a-1bb8750bcd85 req-324ed107-de7d-44e0-9c86-f28003f868d4 service nova] Enqueued Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_rules [ 917.828273] env[69274]: INFO networking_nsxv3.common.synchronization [req-b56008d2-4f18-4809-976a-1bb8750bcd85 req-324ed107-de7d-44e0-9c86-f28003f868d4 service nova] Enqueued Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_members [ 917.828414] env[69274]: INFO networking_nsxv3.common.synchronization [req-b56008d2-4f18-4809-976a-1bb8750bcd85 req-324ed107-de7d-44e0-9c86-f28003f868d4 service nova] Enqueued Resource ID: f429b984-941e-406a-a4c3-0746b00aecf2 with Priority: HIGHEST for action port [ 917.832264] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_rules [ 917.832562] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_members [ 917.832677] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f429b984-941e-406a-a4c3-0746b00aecf2 with Priority: HIGHEST for action port [ 917.833728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.834059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.834059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.834177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.834288] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.836104] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.836260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.836349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.836538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.836698] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.836800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.836865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.838252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.839204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.839332] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.843074] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f429b984-941e-406a-a4c3-0746b00aecf2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.843074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.843074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.843074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.843074] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f429b984-941e-406a-a4c3-0746b00aecf2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.346251] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.346251] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.346251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.348151] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f429b984-941e-406a-a4c3-0746b00aecf2 with status ACTIVE [ 918.348333] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.348455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.348521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.349616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.349616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.349616] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.349616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.349616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.349616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.349616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.350059] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.350059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.350059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.350416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.350416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.350416] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f429b984-941e-406a-a4c3-0746b00aecf2 is going to be updated. [ 918.374338] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.374338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.374338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.374338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.374338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.374338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f429b984-941e-406a-a4c3-0746b00aecf2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.847397] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.353413] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.353755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.353857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.354129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.354261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.354396] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a is going to be created. [ 919.393882] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.393882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.393882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.393882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.393882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.413684] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a in Status: UNINITIALIZED for 2s [ 919.746645] env[69274]: INFO networking_nsxv3.common.synchronization [None req-16d88b5e-0465-4801-a7dc-6ad22b94f94c None None] Enqueued Resource ID: 3c332568-7cd6-4727-9ae7-4fe8deaedf4d with Priority: HIGHEST for action port [ 919.746948] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c332568-7cd6-4727-9ae7-4fe8deaedf4d with Priority: HIGHEST for action port [ 919.747566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c332568-7cd6-4727-9ae7-4fe8deaedf4d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.747725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c332568-7cd6-4727-9ae7-4fe8deaedf4d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.747797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c332568-7cd6-4727-9ae7-4fe8deaedf4d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.748278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c332568-7cd6-4727-9ae7-4fe8deaedf4d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.748406] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c332568-7cd6-4727-9ae7-4fe8deaedf4d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.168295] env[69274]: INFO networking_nsxv3.common.synchronization [req-b9d320d7-1316-4808-b1ef-ba1a28ffcd6c req-09740289-011b-4ca7-8c24-e5b6eded3713 tempest-ListServerFiltersTestJSON-1290336512 tempest-ListServerFiltersTestJSON-1290336512-project-member] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 920.169199] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGHEST for action security_group_members [ 920.169593] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.171789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.171789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.171789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.171789] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.171789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.171789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.171789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.171789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.171789] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.253213] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c332568-7cd6-4727-9ae7-4fe8deaedf4d [ 920.254012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.254012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.254012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.254012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.254012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.254315] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c332568-7cd6-4727-9ae7-4fe8deaedf4d already deleted. [ 920.254315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c332568-7cd6-4727-9ae7-4fe8deaedf4d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.444632] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.445085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.445085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.445401] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.446043] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.446043] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.446043] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.447062] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.447281] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.447467] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.447595] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.447713] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.447947] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.447947] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.448070] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.448218] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.470095] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.470348] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.471039] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.471039] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-678" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.471367] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b18f49b1-da80-4541-a74c-f149458a21d7 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.471490] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.471579] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.472163] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.472163] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18f49b1-da80-4541-a74c-f149458a21d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.674425] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.674425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.674591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.676363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.676363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.676647] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.676647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.676791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.678344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.678452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.678561] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be updated. [ 920.707162] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.707336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.707400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.707587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.707880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.718957] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: IN_PROGRESS for 2s [ 920.975117] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.975117] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.975335] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.975516] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.975694] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.976052] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.976229] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.976384] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.976642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.976828] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.977189] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.977365] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.977486] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.977753] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.977897] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.978098] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b18f49b1-da80-4541-a74c-f149458a21d7 is going to be updated. [ 921.002265] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.002499] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.002651] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.003070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.003180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.003718] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.425351] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a in Status: SUCCESS [ 921.425604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.426826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.426826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.426826] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.426826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.426826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.426826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.426826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.426826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.427222] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.843904] env[69274]: INFO networking_nsxv3.common.synchronization [req-020e9672-407c-4af8-8090-7d1339dbe072 req-959a36b6-2c87-4f1f-860a-7096f0fe215c service nova] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_rules [ 921.844175] env[69274]: INFO networking_nsxv3.common.synchronization [req-020e9672-407c-4af8-8090-7d1339dbe072 req-959a36b6-2c87-4f1f-860a-7096f0fe215c service nova] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 921.844269] env[69274]: INFO networking_nsxv3.common.synchronization [req-020e9672-407c-4af8-8090-7d1339dbe072 req-959a36b6-2c87-4f1f-860a-7096f0fe215c service nova] Enqueued Resource ID: b18f49b1-da80-4541-a74c-f149458a21d7 with Priority: HIGHEST for action port [ 921.844844] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_rules [ 921.844988] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 921.845377] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b18f49b1-da80-4541-a74c-f149458a21d7 with Priority: HIGHEST for action port [ 921.845728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.845903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.846017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.848916] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.848916] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.848916] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.848916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.848916] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.851391] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b18f49b1-da80-4541-a74c-f149458a21d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.851391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.851391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.851638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.851850] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18f49b1-da80-4541-a74c-f149458a21d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.928868] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.314257] env[69274]: INFO networking_nsxv3.common.synchronization [None req-8e63f3f3-3467-4d31-bae1-8d8586d278bf None None] Enqueued Resource ID: 5a17fb96-0780-450f-bb2c-524e7f6cd1b2 with Priority: HIGHEST for action port [ 922.315467] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a17fb96-0780-450f-bb2c-524e7f6cd1b2 with Priority: HIGHEST for action port [ 922.317140] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a17fb96-0780-450f-bb2c-524e7f6cd1b2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.317344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a17fb96-0780-450f-bb2c-524e7f6cd1b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.317458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a17fb96-0780-450f-bb2c-524e7f6cd1b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.317823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a17fb96-0780-450f-bb2c-524e7f6cd1b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.318095] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a17fb96-0780-450f-bb2c-524e7f6cd1b2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.352757] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.354216] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b18f49b1-da80-4541-a74c-f149458a21d7 with status ACTIVE [ 922.354216] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.354473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.354473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.354691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.354859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.355067] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.355161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.355259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.355378] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.355459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.355659] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.356028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.356162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.356358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.356501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.356626] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b18f49b1-da80-4541-a74c-f149458a21d7 is going to be updated. [ 922.357777] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.358380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.379397] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.379477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.379477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.379693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.379837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.380021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b18f49b1-da80-4541-a74c-f149458a21d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.433420] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d18e8e1-0498-42f1-a212-e38138ab2e9a: rpc.has_security_group_logging(os_id): False [ 922.458907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.459916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.459916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.459916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.459916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.460204] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.460286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.460318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.460463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.460593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.460637] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a is going to be created. [ 922.561263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.563815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.563815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.563815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.563815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.582237] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a in Status: IN_PROGRESS for 2s [ 922.731724] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 in Status: SUCCESS [ 922.731927] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 deletion is rescheduled due to dependency. [ 922.732052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.823079] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a17fb96-0780-450f-bb2c-524e7f6cd1b2 [ 922.823079] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.823079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.823318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.823391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.823528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.823633] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a17fb96-0780-450f-bb2c-524e7f6cd1b2 already deleted. [ 922.823722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a17fb96-0780-450f-bb2c-524e7f6cd1b2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.860095] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.363172] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.363380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.363584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.363718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.363828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.363956] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be updated. [ 923.403058] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.403251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.403332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.403571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.404177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.417691] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 923.911282] env[69274]: INFO networking_nsxv3.common.synchronization [req-d885a791-e6f0-45da-ae20-0fbd34c0f700 req-8e2b0ba2-b7a8-4fd1-96ef-3b3a5fe7c917 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 923.912261] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 923.913372] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.913372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.913372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.913372] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.913372] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.913642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.913642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.915543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.915543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.915543] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.419327] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.419327] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.419327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.419327] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be updated. [ 924.497462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.498792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.498792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.501900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.501900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.511299] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: IN_PROGRESS for 2s [ 924.612038] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a in Status: SUCCESS [ 924.612038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.436365] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 925.436365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.437060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.437060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.437060] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.437060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.437441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.437441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.437441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.437664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.437664] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.939984] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.940271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.940413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.940728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.940912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.941057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.941093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.941262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.941350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.941440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.941598] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.941693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.941750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.941891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.942062] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.942131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.942193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.942329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.942419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.942611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.942717] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.448898] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df948508-d1d6-4368-979c-297ed94dda9d: rpc.has_security_group_logging(os_id): False [ 926.472177] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.472371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.473066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.473066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.504400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.504806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.504980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.505081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.505319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.505419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.505702] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.505859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.505936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.506159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.506273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.507100] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.507100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.507100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.507332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.507332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.507332] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be updated. [ 926.525319] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: SUCCESS [ 926.525681] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 deletion is rescheduled due to dependency. [ 926.525897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.594129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.594129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.594129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.594129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.594129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.619648] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 927.049255] env[69274]: INFO networking_nsxv3.common.synchronization [req-43b78a50-7d7c-4ddb-a81e-cc1f4980e541 req-4188679d-fcb5-47b3-9d19-1b0973e7cd27 tempest-ServersAdminTestJSON-376381935 tempest-ServersAdminTestJSON-376381935-project-member] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 927.050020] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGHEST for action security_group_members [ 927.054122] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.054435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.054606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.054946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.055266] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.055432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.055579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.055853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.056052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.056207] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.559096] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.561472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.561472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.561472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.589046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.589046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.589046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.589046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.589046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.589046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.589046] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be updated. [ 927.618584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.618803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.618803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.619013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.619171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.631637] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: IN_PROGRESS for 2s [ 927.926026] env[69274]: INFO networking_nsxv3.common.synchronization [req-0556ac9b-5270-4d01-8376-776ab0aebc0a req-ac4dc0a3-2af7-469e-9f9d-294f02cfabd9 tempest-ServerMetadataNegativeTestJSON-1802566392 tempest-ServerMetadataNegativeTestJSON-1802566392-project-member] Enqueued Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_members [ 927.926026] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_members [ 927.926026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.926026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.926026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.926026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.926026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.926026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.926026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.926526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.926526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.927704] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.432083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.432956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.432956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.432956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.432956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.433256] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.433341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.433378] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.433624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.433774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.433913] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 already deleted. [ 928.434064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.645505] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.646078] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-344" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.646348] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-344" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.646758] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-344" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.647144] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.647390] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.647569] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.648014] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.648123] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.648366] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.648561] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.648733] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.648899] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.649085] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.649271] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.649471] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.651778] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 928.652113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.697147] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.697506] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.697753] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.698092] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-344" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.698656] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-82f5c61d-4c40-4470-9585-ad57402c81b5 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.698960] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.700269] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.700557] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.700826] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82f5c61d-4c40-4470-9585-ad57402c81b5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.205376] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.205650] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.205916] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.206475] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.206703] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.207011] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 82f5c61d-4c40-4470-9585-ad57402c81b5 not found, creating... [ 929.207731] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.208204] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.208204] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.209325] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.209325] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.212951] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.212951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.212951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.212951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.213126] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.213324] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 82f5c61d-4c40-4470-9585-ad57402c81b5 is going to be created. [ 929.246054] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.246330] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.246434] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.246783] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.247097] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.247382] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.645998] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f in Status: SUCCESS [ 929.646749] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f deletion is rescheduled due to dependency. [ 929.646909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.763597] env[69274]: INFO networking_nsxv3.common.synchronization [req-1919c604-8b02-430a-bbba-bd9019a11bb8 req-20b91a6c-27c6-4a37-b3e5-4e543b4ccc79 tempest-ServersTestJSON-1296568971 tempest-ServersTestJSON-1296568971-project-member] Enqueued Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_members [ 929.764871] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGHEST for action security_group_members [ 929.766394] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.767717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.767717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.767717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.767717] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.767717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.767717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.767717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.767997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.767997] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.141805] env[69274]: INFO networking_nsxv3.common.synchronization [req-0556ac9b-5270-4d01-8376-776ab0aebc0a req-1ad59d90-58c0-49f2-9f65-f5e0f3117393 service nova] Enqueued Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_rules [ 930.142110] env[69274]: INFO networking_nsxv3.common.synchronization [req-0556ac9b-5270-4d01-8376-776ab0aebc0a req-1ad59d90-58c0-49f2-9f65-f5e0f3117393 service nova] Enqueued Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_members [ 930.142265] env[69274]: INFO networking_nsxv3.common.synchronization [req-0556ac9b-5270-4d01-8376-776ab0aebc0a req-1ad59d90-58c0-49f2-9f65-f5e0f3117393 service nova] Enqueued Resource ID: 82f5c61d-4c40-4470-9585-ad57402c81b5 with Priority: HIGHEST for action port [ 930.143225] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_rules [ 930.143225] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_members [ 930.143225] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82f5c61d-4c40-4470-9585-ad57402c81b5 with Priority: HIGHEST for action port [ 930.144550] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.144550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.144550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.144550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.144550] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.146100] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.146100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.146100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.146100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.146100] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.146100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.146100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.146100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.146100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.148885] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.150239] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-82f5c61d-4c40-4470-9585-ad57402c81b5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.150374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.150446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.150891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.150995] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82f5c61d-4c40-4470-9585-ad57402c81b5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.277173] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.277173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.277173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.277173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.302477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.302914] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.303120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.303198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.303418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.305064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.305064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 is going to be updated. [ 930.347243] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.349699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.349891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.350204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.350386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.363621] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 in Status: IN_PROGRESS for 2s [ 930.569803] env[69274]: INFO networking_nsxv3.common.synchronization [req-5aface86-ed79-4b18-9db0-6f8cb1eb514e req-dbbdb3ef-b5ed-42d7-a150-89721f7e7bf0 tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 930.569803] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 930.569803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.569803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.569803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.569803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.569803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.569803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.569803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.569803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.569803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.570827] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.653375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.655894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.655894] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.655894] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82f5c61d-4c40-4470-9585-ad57402c81b5 with status ACTIVE [ 930.655894] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.655894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.655894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.656247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.656247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.656825] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.656825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.656825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.656825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.656825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.657058] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.657664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.657752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.657979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.658157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.658331] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82f5c61d-4c40-4470-9585-ad57402c81b5 is going to be updated. [ 930.680747] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.680901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.680975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.681203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.681348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.681519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82f5c61d-4c40-4470-9585-ad57402c81b5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.885104] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.885327] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.885459] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.885813] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.886186] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.886362] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.886491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.886724] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.887045] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.887277] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.887401] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.887519] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.887643] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.887762] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.887877] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.888029] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.909661] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.910015] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.910486] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.911266] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.911364] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-eba92ed4-9055-4ef4-b799-c136474d9c87 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.911628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.911827] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.912371] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.912606] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba92ed4-9055-4ef4-b799-c136474d9c87',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.072643] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.072994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.072994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.073572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.073572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.074093] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.074093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.074093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.074093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.075714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.075714] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb already deleted. [ 931.075714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.161292] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.209206] env[69274]: INFO networking_nsxv3.common.synchronization [req-2907fe99-20a5-44a1-8777-ae8b09e923a9 req-1e20e38f-257a-4d38-9b8f-0e92711b6285 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 931.212722] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 931.213115] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.214313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.214313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.214313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.214313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.214313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.214313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.214313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.214313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.214664] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.418539] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.418969] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.418969] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.419532] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.419532] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.419615] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port eba92ed4-9055-4ef4-b799-c136474d9c87 not found, creating... [ 931.419825] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.420587] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.420587] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.420587] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.420587] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.420821] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.420958] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.421100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.421325] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.421466] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.421617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: eba92ed4-9055-4ef4-b799-c136474d9c87 is going to be created. [ 931.449370] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.449609] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.449740] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.450272] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.450386] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.450562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.657845] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.658449] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.658449] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.658814] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.658814] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.659216] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.659400] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.659702] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.659908] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.660159] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.660287] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.660474] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.660662] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.660804] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 931.660929] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.661178] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.663300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.663502] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.663625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.663809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.663893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.663993] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 is going to be created. [ 931.685686] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.685686] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 931.685686] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.686086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.686294] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-ccccce56-9840-439f-966a-dc6e83b377ba taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.686496] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.686659] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.687663] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.687850] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccccce56-9840-439f-966a-dc6e83b377ba',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.693293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.693293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.693293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.693293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.693293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.710738] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 in Status: UNINITIALIZED for 2s [ 931.716886] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.716886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.716886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.717162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.717196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.717433] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.717491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.717558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.717752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.717915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.717915] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 already deleted. [ 931.718017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.193201] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.193201] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.193201] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.193201] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.193201] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.193777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port ccccce56-9840-439f-966a-dc6e83b377ba not found, creating... [ 932.193777] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.193862] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.193942] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.194191] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.197024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.197024] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.197024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.197024] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.197819] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.198075] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.198308] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: ccccce56-9840-439f-966a-dc6e83b377ba is going to be created. [ 932.231190] env[69274]: INFO networking_nsxv3.common.synchronization [req-5aface86-ed79-4b18-9db0-6f8cb1eb514e req-00c9f6a4-538f-47dd-8e45-83bd483d7e69 service nova] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 932.231190] env[69274]: INFO networking_nsxv3.common.synchronization [req-5aface86-ed79-4b18-9db0-6f8cb1eb514e req-00c9f6a4-538f-47dd-8e45-83bd483d7e69 service nova] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 932.231190] env[69274]: INFO networking_nsxv3.common.synchronization [req-5aface86-ed79-4b18-9db0-6f8cb1eb514e req-00c9f6a4-538f-47dd-8e45-83bd483d7e69 service nova] Enqueued Resource ID: eba92ed4-9055-4ef4-b799-c136474d9c87 with Priority: HIGHEST for action port [ 932.231446] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 932.232582] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 932.232582] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba92ed4-9055-4ef4-b799-c136474d9c87 with Priority: HIGHEST for action port [ 932.232958] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.232958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.233194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.233706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.233706] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.236843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.237021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.237092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.237337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.237803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.238549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.238626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.238861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.239250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.239438] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.241283] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba92ed4-9055-4ef4-b799-c136474d9c87 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.241651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.241758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.242852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.242954] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba92ed4-9055-4ef4-b799-c136474d9c87',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.247664] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.247966] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.248708] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.249238] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.249987] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.249987] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.377806] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 in Status: SUCCESS [ 932.378030] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 deletion is rescheduled due to dependency. [ 932.378096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.746891] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.746891] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.746891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.755186] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eba92ed4-9055-4ef4-b799-c136474d9c87 with status ACTIVE [ 932.755186] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.755186] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.755186] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.755186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.755186] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eba92ed4-9055-4ef4-b799-c136474d9c87 is going to be updated. [ 932.782711] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.782711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.782711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.782711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.782711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.782711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.163260] env[69274]: INFO networking_nsxv3.common.synchronization [req-2907fe99-20a5-44a1-8777-ae8b09e923a9 req-1b5b5458-444e-41d8-9318-1037d15808c5 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 933.163477] env[69274]: INFO networking_nsxv3.common.synchronization [req-2907fe99-20a5-44a1-8777-ae8b09e923a9 req-1b5b5458-444e-41d8-9318-1037d15808c5 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 933.163647] env[69274]: INFO networking_nsxv3.common.synchronization [req-2907fe99-20a5-44a1-8777-ae8b09e923a9 req-1b5b5458-444e-41d8-9318-1037d15808c5 service nova] Enqueued Resource ID: ccccce56-9840-439f-966a-dc6e83b377ba with Priority: HIGHEST for action port [ 933.164340] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 933.165034] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 933.165034] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccccce56-9840-439f-966a-dc6e83b377ba with Priority: HIGHEST for action port [ 933.165034] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.165207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.165259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.165543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.167018] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.167018] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.167018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.167565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.167565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.167565] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.167688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.167724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.171027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.171027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.171027] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.171027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccccce56-9840-439f-966a-dc6e83b377ba taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.171027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.171027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.171027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.171027] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccccce56-9840-439f-966a-dc6e83b377ba',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.247491] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.672409] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.675969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.675969] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccccce56-9840-439f-966a-dc6e83b377ba with status ACTIVE [ 933.675969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.675969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.675969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.680257] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.680554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.680648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.680911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.681245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.681245] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccccce56-9840-439f-966a-dc6e83b377ba is going to be updated. [ 933.732376] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 in Status: SUCCESS [ 933.732716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.732924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.733540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.733540] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.733540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.733798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.733798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.733875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.733963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.734117] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.741408] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.741579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.741579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.741788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.741936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.742133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccccce56-9840-439f-966a-dc6e83b377ba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.750663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.751120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.751120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.751274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.751442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.751500] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb is going to be created. [ 933.818337] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.818537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.818579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.818771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.818941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.837764] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: UNINITIALIZED for 2s [ 934.184039] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.236597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.236776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.236875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.237260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.237542] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.237936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.237936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.238129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.238129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.238252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.238526] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.238675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.238764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.238972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.239149] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.239253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.239331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.239504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.239599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.239693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.239804] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.690976] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.691233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.691326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.691653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.691790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.691880] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be created. [ 934.720225] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.720417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.720491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.720753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.721025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.738476] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: UNINITIALIZED for 2s [ 934.743057] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5cb5dff3-3fac-48a6-b59f-5932902148b8: rpc.has_security_group_logging(os_id): False [ 934.766610] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.766993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.766993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.767258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.767405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.767660] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.767821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.767926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.768139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.768276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.768532] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.768702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.768807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.769143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.769278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.769525] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.769806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.769908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.770115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.770257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.770403] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 is going to be created. [ 934.844169] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.844398] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.844398] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.844605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.844835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.858379] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 in Status: IN_PROGRESS for 2s [ 935.852865] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: SUCCESS [ 935.852865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.852865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.852865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.852865] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.852865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.852865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.852865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.853391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.853391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.853391] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.313445] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b316da99-d177-459e-a58b-f38285061dff tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: 0dfe082f-3705-495a-a22f-107711062671 with Priority: HIGHEST for action security_group_rules [ 936.314257] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfe082f-3705-495a-a22f-107711062671 with Priority: HIGHEST for action security_group_rules [ 936.314615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dfe082f-3705-495a-a22f-107711062671 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.314820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.314879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.315141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.315426] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dfe082f-3705-495a-a22f-107711062671',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.356078] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.407786] env[69274]: INFO networking_nsxv3.common.synchronization [None req-1ff7757e-5caf-4ca0-81e7-a21fcd5c50b9 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: 0dfe082f-3705-495a-a22f-107711062671 with Priority: HIGHEST for action security_group_rules [ 936.408478] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dfe082f-3705-495a-a22f-107711062671 with Priority: HIGHEST for action security_group_rules [ 936.408847] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dfe082f-3705-495a-a22f-107711062671 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.408986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.756039] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 936.757300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.757300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.757300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.757539] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.757539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.757539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.758385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.758385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.758385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.758385] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.847154] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.847313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.847391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.847628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.847715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.847811] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dfe082f-3705-495a-a22f-107711062671 already deleted. [ 936.847907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.848469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.848636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.848722] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dfe082f-3705-495a-a22f-107711062671',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.861686] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1c536af-bbdd-43d4-96ae-ba31d5403fdb: rpc.has_security_group_logging(os_id): False [ 936.874624] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 in Status: SUCCESS [ 936.874918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.879870] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.880023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.880607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.880607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.880607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.880791] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.880899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.880965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.881135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.881213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.881300] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb is going to be created. [ 936.948801] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.949073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.949583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.949672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.949908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.965288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: IN_PROGRESS for 2s [ 937.023783] env[69274]: INFO networking_nsxv3.common.synchronization [None req-689eb539-67b1-4b84-b80d-1e3e7aafc468 None None] Enqueued Resource ID: c895a8ca-4910-41c9-8d24-8612edc4f2db with Priority: HIGHEST for action port [ 937.024750] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c895a8ca-4910-41c9-8d24-8612edc4f2db with Priority: HIGHEST for action port [ 937.024750] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c895a8ca-4910-41c9-8d24-8612edc4f2db taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.025285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c895a8ca-4910-41c9-8d24-8612edc4f2db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.025285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c895a8ca-4910-41c9-8d24-8612edc4f2db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.025285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c895a8ca-4910-41c9-8d24-8612edc4f2db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.025285] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c895a8ca-4910-41c9-8d24-8612edc4f2db',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.260876] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.261043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.261127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.262359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.262359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.262359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.262810] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.262810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.262810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.262810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.262960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.262960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.263089] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.382930] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.382930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.382930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.382930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.382930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.382930] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dfe082f-3705-495a-a22f-107711062671 already deleted. [ 937.382930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dfe082f-3705-495a-a22f-107711062671" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.528291] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c895a8ca-4910-41c9-8d24-8612edc4f2db [ 937.528519] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.528706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.528799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.528937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.529104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.529171] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c895a8ca-4910-41c9-8d24-8612edc4f2db already deleted. [ 937.529212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c895a8ca-4910-41c9-8d24-8612edc4f2db" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.766947] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb1c245e-fab2-4558-9acb-1f5c9442e963: rpc.has_security_group_logging(os_id): False [ 937.789025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.789226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.789226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.789358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.789413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.790174] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.790174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.790174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.790174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.790174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.790428] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.790428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.790428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.791213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.791213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.791213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.791213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.791213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.791213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.791213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.791451] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be created. [ 937.859555] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.859555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.859555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.859555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.859827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.876411] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 938.977065] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7d845579-1b6f-48da-8187-fb6b676381d2 None None] Enqueued Resource ID: fdc99a3c-a758-4a18-9400-68ff806436c2 with Priority: HIGHEST for action port [ 938.977733] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc99a3c-a758-4a18-9400-68ff806436c2 with Priority: HIGHEST for action port [ 938.978217] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdc99a3c-a758-4a18-9400-68ff806436c2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.978361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdc99a3c-a758-4a18-9400-68ff806436c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.978421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdc99a3c-a758-4a18-9400-68ff806436c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.978684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdc99a3c-a758-4a18-9400-68ff806436c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.978775] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdc99a3c-a758-4a18-9400-68ff806436c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.986048] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: SUCCESS [ 938.987221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.481781] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdc99a3c-a758-4a18-9400-68ff806436c2 [ 939.482077] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.482193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.482258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.482664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.482664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.482778] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdc99a3c-a758-4a18-9400-68ff806436c2 already deleted. [ 939.482778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdc99a3c-a758-4a18-9400-68ff806436c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.891077] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 939.891077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.117514] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-044889de-51ca-4e48-be7f-49397eb5c52c tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 940.119072] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 940.119072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.119072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.119072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.119072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.119072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.119616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.119714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.119889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.120013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.120113] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.482511] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-0d85602e-9e18-4e0e-bdad-5f78f584104b tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 940.483101] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 940.484784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.484921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.625024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.625024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.625024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.625024] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 940.671786] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.671988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.672115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.672281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.672485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.684264] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 940.993602] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.993960] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-479" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.993960] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-479" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.994277] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-479" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.994549] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.994713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.994838] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.998090] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.998871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.998871] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.998871] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.998871] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.999160] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.999160] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.999252] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.999422] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.024088] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.024279] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.024445] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.024740] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-479" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.025188] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.025378] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.025530] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.026908] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.026908] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf7b3b8c-5a22-4320-80bb-057f0f5b3fef',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.533688] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.534103] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.534174] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.534469] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.534630] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.534802] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port bf7b3b8c-5a22-4320-80bb-057f0f5b3fef not found, creating... [ 941.535112] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.535284] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.535409] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.535746] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.535814] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.541141] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.541141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.541141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.541141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.541141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.541141] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: bf7b3b8c-5a22-4320-80bb-057f0f5b3fef is going to be created. [ 941.567081] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.567081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.567081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.567081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.568207] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.568207] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.366632] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-8defee80-3ed3-4212-b84a-48a71fab3a9e service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 942.366690] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-8defee80-3ed3-4212-b84a-48a71fab3a9e service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 942.366893] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-8defee80-3ed3-4212-b84a-48a71fab3a9e service nova] Enqueued Resource ID: bf7b3b8c-5a22-4320-80bb-057f0f5b3fef with Priority: HIGHEST for action port [ 942.367367] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 942.367505] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 942.367609] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7b3b8c-5a22-4320-80bb-057f0f5b3fef with Priority: HIGHEST for action port [ 942.367925] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.368293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.368412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.368681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.368768] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.369667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.371787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.371787] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.371787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.371787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.371787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.371787] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf7b3b8c-5a22-4320-80bb-057f0f5b3fef',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.697356] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 942.697619] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 deletion is rescheduled due to dependency. [ 942.697715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.697950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.698159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.698347] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.698467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.698532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.698705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.698762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.698861] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.872161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.872374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.874749] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf7b3b8c-5a22-4320-80bb-057f0f5b3fef with status ACTIVE [ 942.874975] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.875128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.875199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.875417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.875511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.875699] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.875790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.875880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.875999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.876094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.876276] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.876475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.876475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.876585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.876662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.876748] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf7b3b8c-5a22-4320-80bb-057f0f5b3fef is going to be updated. [ 942.901834] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.902039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.902126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.902368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.902772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.902772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf7b3b8c-5a22-4320-80bb-057f0f5b3fef" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.202125] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.351171] env[69274]: INFO networking_nsxv3.common.synchronization [req-abb18a51-1aae-4e40-84c6-1746579bde75 req-d9318e55-5200-4fb8-bb62-d30faf1d1240 tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 943.352051] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 943.352258] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.352405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.352475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.352713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.352871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.352964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.353555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.353555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.353555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.353555] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.416479] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.417014] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-120" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.417014] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-120" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.417158] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-120" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.417409] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.417689] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.417839] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.418092] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.418247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.418464] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.418583] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.418703] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.418816] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.418955] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.419083] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.419274] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.444192] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.444192] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.444192] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.444192] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-120" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.444192] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-89f69985-d819-4009-9ba0-444661069644 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.444422] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.444422] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.444788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.444990] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89f69985-d819-4009-9ba0-444661069644',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.610189] env[69274]: INFO networking_nsxv3.common.synchronization [req-7657b4f1-cfea-4c33-a4fc-f1f0f8b5d270 req-f0d68de8-bcff-47b1-9537-71100ebea309 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 943.610696] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 943.610917] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.611058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.611130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.611333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.611489] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.611621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.611727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.611811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.611952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.612014] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.705630] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.858313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.858313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.858313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.858313] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 943.901366] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.901366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.901366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.901366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.901366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.909310] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 943.948707] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.949315] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.949619] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.949993] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.950377] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.951524] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 89f69985-d819-4009-9ba0-444661069644 not found, creating... [ 943.951991] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.952527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.952803] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.956279] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.956585] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.959180] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.959180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.959180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.959180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.959180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.959180] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 89f69985-d819-4009-9ba0-444661069644 is going to be created. [ 943.985034] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.985034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.985034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.985034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.985034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.985034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.117748] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.117958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.118179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.118424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.118522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.118737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.118843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.118901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.119062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.119140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.119233] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 944.203114] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.203114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.203114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.203114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.203114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.208039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.208203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.208203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.208448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.208541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.209961] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 944.216987] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 944.264605] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.264779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.264854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.265111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.265259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.279173] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 944.858812] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-92b6014b-459f-45bb-a9d6-870bffffee2d service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 944.859131] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-92b6014b-459f-45bb-a9d6-870bffffee2d service nova] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 944.859131] env[69274]: INFO networking_nsxv3.common.synchronization [req-575c6e14-62c6-42a2-a874-03622e484900 req-92b6014b-459f-45bb-a9d6-870bffffee2d service nova] Enqueued Resource ID: 89f69985-d819-4009-9ba0-444661069644 with Priority: HIGHEST for action port [ 944.859683] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_rules [ 944.859824] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 944.859924] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89f69985-d819-4009-9ba0-444661069644 with Priority: HIGHEST for action port [ 944.860309] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.860454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.860818] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.860930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.861218] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-89f69985-d819-4009-9ba0-444661069644 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.861376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.861376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.861609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.861718] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89f69985-d819-4009-9ba0-444661069644',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.365058] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89f69985-d819-4009-9ba0-444661069644 with status ACTIVE [ 945.365218] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.365527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.365527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.365658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.365746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.365940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.366058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.366123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.366624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.366624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.366624] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.366797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.366797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.366863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.366907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.367702] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89f69985-d819-4009-9ba0-444661069644 is going to be updated. [ 945.387055] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.387160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.387160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.387365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.387506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.387667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89f69985-d819-4009-9ba0-444661069644" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.923593] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 945.923970] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 deletion is rescheduled due to dependency. [ 945.923970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.234618] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 946.234811] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 946.234918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.291333] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 946.291518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.291733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.292080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.292764] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.292764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.292764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.292990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.292990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.293083] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.796129] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.839925] env[69274]: INFO networking_nsxv3.common.synchronization [req-0addfc1f-c66b-426a-a4d1-82c7dfbb7701 req-70691142-1f2d-4147-bf59-4059f14971ef tempest-ServerMetadataNegativeTestJSON-1802566392 tempest-ServerMetadataNegativeTestJSON-1802566392-project-member] Enqueued Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_members [ 946.840396] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGHEST for action security_group_members [ 946.840788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.840944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.841055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.841297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.841486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.841625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.841712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.841908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.842035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.842160] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.302580] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.344740] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.344972] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.345093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.345306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.345393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.345597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.345716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.345778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.345932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.346016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.346107] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 is going to be updated. [ 947.379073] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.379297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.379394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.379661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.379884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.391896] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 in Status: IN_PROGRESS for 2s [ 947.808275] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.808275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.808275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.808275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.808275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.808275] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 947.843427] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.843560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.843671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.843875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.844029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.855444] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 948.153194] env[69274]: INFO networking_nsxv3.common.synchronization [None req-08069b58-2ad5-4b15-ba8b-90434a91bb56 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_rules [ 948.153866] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_rules [ 948.154229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.154356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.154801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.154801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.154801] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.255698] env[69274]: INFO networking_nsxv3.common.synchronization [None req-13761426-78df-445a-8fa2-c1e66e6794a7 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_rules [ 948.256972] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_rules [ 948.259732] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.259732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.677295] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.677295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.677295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.677295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.677295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.677295] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 already deleted. [ 948.677295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.677295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.677295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.677295] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.201896] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.202179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.202277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.202583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.202779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.202889] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 already deleted. [ 949.202983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.404687] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 in Status: SUCCESS [ 949.404849] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 deletion is rescheduled due to dependency. [ 949.404849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.785731] env[69274]: INFO networking_nsxv3.common.synchronization [req-df851fce-47c2-4922-af8f-b86ac06b6e9d req-b5ff8c89-3c91-4640-8a92-6f161c7db215 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 949.786087] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 949.786433] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.786553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.786632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.786835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.786988] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.787942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.788078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.788281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.788438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.788745] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.871603] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 949.871959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.873177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.873701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.873800] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.873886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.873955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.874876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.874978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.875104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.875272] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.876376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.876484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.876696] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.883261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.883261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.883261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.883261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.883261] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.073171] env[69274]: INFO networking_nsxv3.common.synchronization [req-72d64d09-72eb-4354-81a7-8928c2effae3 req-1d214a95-e765-4f4d-bb2a-04a282220d5b tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 950.073171] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 950.073447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.073739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.073926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.074282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.074550] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.074805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.074962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.075233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.075412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.075594] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.294259] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.294259] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.294259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.294259] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 950.324586] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.324586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.324586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.324586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.324586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.331456] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 950.384803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.384803] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.384803] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.459066] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.459358] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.459527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.459887] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.460179] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.460342] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.460500] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.460720] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.460884] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.461119] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.461243] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.461357] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.461472] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.461584] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 950.461695] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.461831] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.484674] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.484862] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 950.485118] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.485248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.485575] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-ca7a9156-837f-4d9c-9a20-3915d5435a7c taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.485756] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.485954] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.486314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.486465] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7a9156-837f-4d9c-9a20-3915d5435a7c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.577966] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.578130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.578190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.578397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.578491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.578739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.578866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.578866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.579070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.579157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.579938] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 already deleted. [ 950.579938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.886922] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.989052] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.989052] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.989052] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.989450] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.989656] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.989835] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port ca7a9156-837f-4d9c-9a20-3915d5435a7c not found, creating... [ 950.990144] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.990327] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.990453] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.990754] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.990922] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.991278] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.991451] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.991574] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.991873] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.992026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.992182] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: ca7a9156-837f-4d9c-9a20-3915d5435a7c is going to be created. [ 951.015927] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.016125] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.016175] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.016430] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.016659] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.016889] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.389627] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.389859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.389859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.390099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.390241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.390357] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 951.424162] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.424366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.424414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.425425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.425425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.436111] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 952.033358] env[69274]: INFO networking_nsxv3.common.synchronization [req-72d64d09-72eb-4354-81a7-8928c2effae3 req-b52bcae1-5a71-4f8b-95f5-9395ca04b800 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 952.033358] env[69274]: INFO networking_nsxv3.common.synchronization [req-72d64d09-72eb-4354-81a7-8928c2effae3 req-b52bcae1-5a71-4f8b-95f5-9395ca04b800 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 952.033358] env[69274]: INFO networking_nsxv3.common.synchronization [req-72d64d09-72eb-4354-81a7-8928c2effae3 req-b52bcae1-5a71-4f8b-95f5-9395ca04b800 service nova] Enqueued Resource ID: ca7a9156-837f-4d9c-9a20-3915d5435a7c with Priority: HIGHEST for action port [ 952.033358] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 952.033358] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 952.033358] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7a9156-837f-4d9c-9a20-3915d5435a7c with Priority: HIGHEST for action port [ 952.033358] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.033825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.033825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.033825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.033975] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.034988] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.036940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.036940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.036940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.036940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.036940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.036940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.036940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.036940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.036940] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.037566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca7a9156-837f-4d9c-9a20-3915d5435a7c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.037566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.037566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.037566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.037759] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7a9156-837f-4d9c-9a20-3915d5435a7c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.164932] env[69274]: INFO networking_nsxv3.common.synchronization [None req-1e11fb73-1a2c-429c-9adf-eb94f3d56aa7 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_rules [ 952.165539] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_rules [ 952.165896] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.166161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.166334] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.166726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.166946] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.281319] env[69274]: INFO networking_nsxv3.common.synchronization [None req-ab786f4e-cd76-497c-8073-0662ad692416 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_rules [ 952.281916] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_rules [ 952.282521] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.282886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.343559] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 952.343559] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 deletion is rescheduled due to dependency. [ 952.343559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.539434] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.542705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.542705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.543259] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca7a9156-837f-4d9c-9a20-3915d5435a7c with status ACTIVE [ 952.543357] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.543479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.543547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.543789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.543894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.544085] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.544187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.544251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.544415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.544505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.544691] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.544790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.544852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.545018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.545175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.545231] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca7a9156-837f-4d9c-9a20-3915d5435a7c is going to be updated. [ 952.569621] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.569621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.569621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.569621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.569621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.569621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca7a9156-837f-4d9c-9a20-3915d5435a7c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.690811] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.691062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.691062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.691304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.691415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.691537] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc already deleted. [ 952.691629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.691789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.691955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.692054] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.043996] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.219243] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.219243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.219243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.219243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.219243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.219243] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc already deleted. [ 953.219243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.447950] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 953.448219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.448395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.448648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.448990] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.449141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.449209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.449370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.449460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.449551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.449724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.449822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.449887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.450127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.450284] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.450468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.450468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.450708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.450821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.450942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.451100] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.550963] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.551116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.551224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.554119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.554119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.554119] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be created. [ 953.555057] env[69274]: INFO networking_nsxv3.common.synchronization [req-8c832e8c-5152-4afc-94d9-f4fcd2ff9bbc req-7d907322-94a9-4fc1-bf44-898cb1a645f8 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_members [ 953.555277] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGHEST for action security_group_members [ 953.556126] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.556932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.557074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.557596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.557596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.558310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.558310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.558310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.558310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.558533] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.581359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.581359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.581359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.581814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.581814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.599389] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: UNINITIALIZED for 2s [ 953.954952] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99b68d96-5b1d-4bdb-9748-7b151abff183: rpc.has_security_group_logging(os_id): False [ 953.974280] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.974523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.974523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.975165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.975165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.975165] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.975165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.976447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.976447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.976447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.977167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.977385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.977460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.977564] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 954.062365] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.062715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.062715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.066019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.066019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.066019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.066019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.066019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.066019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.067478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.067718] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.067831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.068371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.068371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.068371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.068371] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d is going to be updated. [ 954.083670] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 954.102223] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.102223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.102223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.102223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.102223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.111486] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d in Status: IN_PROGRESS for 2s [ 955.282195] env[69274]: INFO networking_nsxv3.common.synchronization [req-be230587-c995-4397-b311-066951ad0e47 req-fe65357e-514e-46a5-add7-c9461c558fdc tempest-MigrationsAdminTest-608694291 tempest-MigrationsAdminTest-608694291-project-member] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 955.282195] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 955.282195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.282195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.282195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.282195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.282195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.282195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.282195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.282195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.282195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.283252] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.609288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 955.609569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.609759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.610021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.610270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.610424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.610489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.610688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.610773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.610885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.610986] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.786176] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.097346] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 956.097642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.098134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.098416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.098533] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.113131] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.113325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.113366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.113549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.113747] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.113865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.113970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.114646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.114790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.114918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.115132] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.115249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.115340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.115506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.115690] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.115807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.115880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.116038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.116122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.116208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.116301] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.124954] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d in Status: SUCCESS [ 956.125402] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d deletion is rescheduled due to dependency. [ 956.125549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.288394] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.600763] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.600763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.600763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.602867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.602867] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.602867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.602867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.602867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.602867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.602867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.602867] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.618983] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf62572c-aed8-4405-8e2e-513d1f9f3976: rpc.has_security_group_logging(os_id): False [ 956.638211] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.638363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.638438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.638948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.639090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.639341] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.639426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.639494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.639666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.639750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.639931] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.640558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.640651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.640817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.640902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.641153] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.641251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.641301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.641452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.641527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.641612] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be created. [ 956.701807] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.702026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.702026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.702279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.702491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.713056] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 956.737479] env[69274]: INFO networking_nsxv3.common.synchronization [req-d58e77ea-7403-4c32-b7af-a6ebc7695923 req-abbd09fc-0c12-40c0-8fac-8af162fbd808 tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 956.738508] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 956.738508] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.738718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.738718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.738978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.739217] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.739407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.739479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.739733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.740144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.740144] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.790969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.791174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.791272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.791525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.791625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.791732] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be updated. [ 956.859400] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.859609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.859712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.860058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.860252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.875340] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: IN_PROGRESS for 2s [ 957.039914] env[69274]: INFO networking_nsxv3.common.synchronization [req-d58e77ea-7403-4c32-b7af-a6ebc7695923 req-becffd83-45c4-4103-be52-5e9ad66c0890 tempest-ServersTestMultiNic-194744650 tempest-ServersTestMultiNic-194744650-project-member] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 957.040505] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGHEST for action security_group_members [ 957.040933] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.041104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.104778] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.104778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.245173] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.747897] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.249833] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.249991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.250071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.250304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.250504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.250504] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 958.283101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.283289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.283388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.283663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.283861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.294518] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 958.726175] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 958.726277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.883066] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 958.883371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.304956] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 960.305293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.305535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.305620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.305811] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.305928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.306035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.306152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.306231] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.306510] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.412058] env[69274]: INFO networking_nsxv3.common.synchronization [req-91a91723-8cb6-4048-ab91-1e935833b431 req-7f614152-1e5a-4853-98bd-b012b531bbc1 tempest-ServersNegativeTestJSON-1840850554 tempest-ServersNegativeTestJSON-1840850554-project-member] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 960.412959] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGHEST for action security_group_members [ 960.413261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.415032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.415032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.415032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.415032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.415032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.415032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.415032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.415032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.415032] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.811027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.811027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.811027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.811027] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 960.839049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.839049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.839049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.839360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.839360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.848802] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 960.917793] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.917997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.918086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.918350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.918473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.918713] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.918813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.918890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.919107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.919183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.919280] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be updated. [ 960.997886] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.998126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.998126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.998398] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.998582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.008996] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: IN_PROGRESS for 2s [ 962.465812] env[69274]: INFO networking_nsxv3.common.synchronization [req-7f19b2d3-2465-4fa9-ae58-139fd414ec19 req-5ed78644-7191-4e59-872a-9206bc40987b tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 962.466380] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 962.466690] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.466809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.467354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.467974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.469109] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.469109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.469109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.469109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.469109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.469109] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.861159] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 962.861351] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 deletion is rescheduled due to dependency. [ 962.861477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.861678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.861911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.862174] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.862305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.862376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.862527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.862611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.862703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.862887] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.862978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.863054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.863209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.863363] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.863457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.863511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.863662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.863776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.863856] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.863950] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.971410] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.971572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.971636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.971863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.971961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.972181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.972283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.972348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.972524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.972609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.972698] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 963.004179] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.004179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.004179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.004438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.004496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.015951] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 963.024446] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df948508-d1d6-4368-979c-297ed94dda9d in Status: SUCCESS [ 963.024639] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df948508-d1d6-4368-979c-297ed94dda9d deletion is rescheduled due to dependency. [ 963.024758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.341974] env[69274]: INFO networking_nsxv3.common.synchronization [req-40f4faa1-08ff-4c22-a532-05e7cca719a6 req-6d014107-16a0-4ec1-8da1-f1338326b9fc tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 963.342567] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 963.342923] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.343552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.343635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.343878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.344042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.344150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.344213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.344375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.344449] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.345331] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.366596] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99b68d96-5b1d-4bdb-9748-7b151abff183: rpc.has_security_group_logging(os_id): False [ 963.387247] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.388110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.388203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.388454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.392025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.392025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.392025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.392025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.392702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.392702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.392702] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be updated. [ 963.458564] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.458728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.458835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.459035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.459360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.476877] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: IN_PROGRESS for 2s [ 963.768045] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.768045] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.768045] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.768045] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.768929] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.771110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.771110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.771110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.771110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.771110] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.771110] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.771110] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.771110] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.771110] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.771702] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.772098] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.797909] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.797909] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.797909] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.797909] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.797909] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-301afa0b-551a-4672-b88e-7758ff5cd166 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.797909] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.798269] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.798740] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.798740] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('301afa0b-551a-4672-b88e-7758ff5cd166',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.853555] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.305070] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.305070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 301afa0b-551a-4672-b88e-7758ff5cd166 not found, creating... [ 964.305070] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.305070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.305652] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.305652] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.306029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.306380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.306625] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.306871] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 301afa0b-551a-4672-b88e-7758ff5cd166 is going to be created. [ 964.331411] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.331411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.331411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.331411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.331411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.331411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.355899] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.859924] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.860283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.860324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.861377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.861377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.861377] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 964.998596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.999864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.000161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.006401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.006401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.014757] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 965.028994] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 965.028994] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 965.028994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.035683] env[69274]: INFO networking_nsxv3.common.synchronization [req-40f4faa1-08ff-4c22-a532-05e7cca719a6 req-77f89a8a-87ef-4f11-93da-7fd43b8d0384 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 965.035683] env[69274]: INFO networking_nsxv3.common.synchronization [req-40f4faa1-08ff-4c22-a532-05e7cca719a6 req-77f89a8a-87ef-4f11-93da-7fd43b8d0384 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 965.035683] env[69274]: INFO networking_nsxv3.common.synchronization [req-40f4faa1-08ff-4c22-a532-05e7cca719a6 req-77f89a8a-87ef-4f11-93da-7fd43b8d0384 service nova] Enqueued Resource ID: 301afa0b-551a-4672-b88e-7758ff5cd166 with Priority: HIGHEST for action port [ 965.035683] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 965.035683] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 965.035683] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 301afa0b-551a-4672-b88e-7758ff5cd166 with Priority: HIGHEST for action port [ 965.036887] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.038410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.038410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.038410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.038410] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.038410] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.038773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.038773] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-301afa0b-551a-4672-b88e-7758ff5cd166 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.038773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.038773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.038937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.039014] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('301afa0b-551a-4672-b88e-7758ff5cd166',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.491462] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 in Status: SUCCESS [ 965.494612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.540944] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.541039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.543181] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 301afa0b-551a-4672-b88e-7758ff5cd166 with status ACTIVE [ 965.543385] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.543523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.543595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.543842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.543940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.544138] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.544243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.544309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.544467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.544546] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.544729] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.544822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.544885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.545034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.545112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.545197] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 301afa0b-551a-4672-b88e-7758ff5cd166 is going to be updated. [ 965.573827] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.573994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.574081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.574581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.574581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.574581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-301afa0b-551a-4672-b88e-7758ff5cd166" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.293630] env[69274]: INFO networking_nsxv3.common.synchronization [req-19ef1eb7-93fd-466e-b973-4e0106576dd9 req-5c1dcfde-6819-4713-af3e-936a6488f85a tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 966.294883] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 966.295642] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.297202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.297202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.297202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.297202] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.297202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.297202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.297202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.297202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.297202] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.306247] env[69274]: INFO networking_nsxv3.common.synchronization [req-e2d50d46-04ee-4d02-8bc6-f2b54c6b4c20 req-308d6f72-f9d6-4c18-b2a7-f9e4eac790ca tempest-ServerAddressesTestJSON-298088711 tempest-ServerAddressesTestJSON-298088711-project-member] Enqueued Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_members [ 966.310623] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_members [ 966.310623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.310623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.310623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.310623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.310623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.310623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.310623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.310623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.310623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.310623] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.796808] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.797025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-980" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.799042] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-980" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.799404] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-980" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.799730] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.800526] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.800684] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.802098] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.802098] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.802098] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.802098] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.802098] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.802098] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.802098] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.802418] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.802719] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.804697] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.804843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.804966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.805109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.814336] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.814336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.825367] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.825544] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.827664] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.827664] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-980" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.827664] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d6dd89f2-7244-4487-a389-ad7c2b578494 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.827664] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.827664] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.827664] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.827664] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6dd89f2-7244-4487-a389-ad7c2b578494',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.829890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.829890] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.829890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.829890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.829890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.832017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.832017] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 966.832017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.832017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.832017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.832017] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.832017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.832017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.832017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.832471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.832636] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe already deleted. [ 966.832857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.865940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.866454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.866830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.867236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.867480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.880594] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 967.032525] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 967.032525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.032525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.032525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.032525] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.032525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.032525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.032525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.032525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.032525] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.334774] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.335228] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.335393] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.335747] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.335868] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.336020] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port d6dd89f2-7244-4487-a389-ad7c2b578494 not found, creating... [ 967.336285] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.336449] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.336568] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.336786] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.336937] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.337243] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.337405] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.337526] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.337886] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.337886] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.338236] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d6dd89f2-7244-4487-a389-ad7c2b578494 is going to be created. [ 967.365890] env[69274]: INFO networking_nsxv3.common.synchronization [None req-a83f630e-332e-4638-b1e9-3b585a6ae653 None None] Enqueued Resource ID: 077a8d53-ff4f-4a1e-8574-f33da2923a8d with Priority: HIGHEST for action port [ 967.367623] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.367623] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.367877] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.367991] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.368318] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.368571] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.369617] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 077a8d53-ff4f-4a1e-8574-f33da2923a8d with Priority: HIGHEST for action port [ 967.369941] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-077a8d53-ff4f-4a1e-8574-f33da2923a8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.370582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-077a8d53-ff4f-4a1e-8574-f33da2923a8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.370582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-077a8d53-ff4f-4a1e-8574-f33da2923a8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.370582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-077a8d53-ff4f-4a1e-8574-f33da2923a8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.370582] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('077a8d53-ff4f-4a1e-8574-f33da2923a8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.535552] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.874479] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 077a8d53-ff4f-4a1e-8574-f33da2923a8d [ 967.874715] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.874860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.874923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.875211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.875298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.875396] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:077a8d53-ff4f-4a1e-8574-f33da2923a8d already deleted. [ 967.875477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-077a8d53-ff4f-4a1e-8574-f33da2923a8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.035508] env[69274]: INFO networking_nsxv3.common.synchronization [req-9fd0d6af-9bad-4bdf-86eb-b5b6d7f0bc07 req-5bd44fb3-b079-494b-bb91-04b7fcd8460e tempest-ServersTestBootFromVolume-1604377893 tempest-ServersTestBootFromVolume-1604377893-project-member] Enqueued Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_members [ 968.036098] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGHEST for action security_group_members [ 968.188345] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.188574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.188650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.188828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.189337] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.189337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.189337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.189628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.189628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.189628] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.192299] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.192993] env[69274]: INFO networking_nsxv3.common.synchronization [req-e2d50d46-04ee-4d02-8bc6-f2b54c6b4c20 req-6b6a49f4-3e1f-458f-9f29-bed176a62296 service nova] Enqueued Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_rules [ 968.193209] env[69274]: INFO networking_nsxv3.common.synchronization [req-e2d50d46-04ee-4d02-8bc6-f2b54c6b4c20 req-6b6a49f4-3e1f-458f-9f29-bed176a62296 service nova] Enqueued Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_members [ 968.193435] env[69274]: INFO networking_nsxv3.common.synchronization [req-e2d50d46-04ee-4d02-8bc6-f2b54c6b4c20 req-6b6a49f4-3e1f-458f-9f29-bed176a62296 service nova] Enqueued Resource ID: d6dd89f2-7244-4487-a389-ad7c2b578494 with Priority: HIGHEST for action port [ 968.194352] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_rules [ 968.194352] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_members [ 968.194476] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6dd89f2-7244-4487-a389-ad7c2b578494 with Priority: HIGHEST for action port [ 968.194690] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.194871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.194871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.195087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.195414] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.196784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.196862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.196862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.197094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.197255] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.197353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.197416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.197566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.197652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.197771] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.198951] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6dd89f2-7244-4487-a389-ad7c2b578494 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.198951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.198951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.199145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.199145] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6dd89f2-7244-4487-a389-ad7c2b578494',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.496728] env[69274]: INFO networking_nsxv3.common.synchronization [req-f414b906-200a-45aa-acce-eb71b785ab83 req-40967d48-3227-4c1e-92ee-3530845d94fc tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 968.497368] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 968.498636] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.498756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.500312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.500312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.500312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.500312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.500312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.500312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.500312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.500312] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.694559] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.694707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.694763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.694970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.695078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.695321] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.695394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.695429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.695577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.695656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.695741] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a is going to be updated. [ 968.696934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.697053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.697125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.697274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.697346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.697433] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 968.702392] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.703419] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.703539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.703617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6dd89f2-7244-4487-a389-ad7c2b578494 with status ACTIVE [ 968.703761] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.704245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.704245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.704245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.704245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.704450] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.704450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.704544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.704664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.704748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.704925] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.705431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.705431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.705431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.705431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.705431] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6dd89f2-7244-4487-a389-ad7c2b578494 is going to be updated. [ 968.741024] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.741169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.741169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.741488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.741488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.744763] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.744898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.744949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.745158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.745288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.747018] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.747289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.747364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.747542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.747667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.747807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6dd89f2-7244-4487-a389-ad7c2b578494" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.759899] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a in Status: IN_PROGRESS for 2s [ 968.760257] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 968.894427] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 968.894850] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 deletion is rescheduled due to dependency. [ 968.895184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.005750] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.006104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.006211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.006589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.006749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.007329] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.007329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.007329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.007591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.007797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.007879] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 969.025903] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.028865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.028865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.028865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.028865] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.028865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.028865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.029380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.029380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.029611] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.029742] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.029885] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.030011] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.030153] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.030270] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.030416] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.053707] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.054330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.054330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.054330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.054563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.063125] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.063448] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.063563] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.063696] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.064077] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-f9ee9231-50b9-49d6-888b-451673c1dd27 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.064270] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.064424] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.064826] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.064975] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ee9231-50b9-49d6-888b-451673c1dd27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.069015] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 969.208883] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.571031] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.571031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port f9ee9231-50b9-49d6-888b-451673c1dd27 not found, creating... [ 969.571031] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.571031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.571714] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.571714] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.571714] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.572301] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.572625] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.572970] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: f9ee9231-50b9-49d6-888b-451673c1dd27 is going to be created. [ 969.596023] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.596023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.596023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.596023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.596023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.596863] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.710726] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.711459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.711695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.713778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.715766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.715766] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe is going to be created. [ 969.747429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.749744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.749744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.749744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.749744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.763288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe in Status: UNINITIALIZED for 2s [ 969.802646] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3f6d7a95-3828-4884-ae5c-06237b61500f None None] Enqueued Resource ID: 7487a557-d944-424b-b716-c73e28cc2ad9 with Priority: HIGHEST for action port [ 969.803124] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7487a557-d944-424b-b716-c73e28cc2ad9 with Priority: HIGHEST for action port [ 969.803677] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-7487a557-d944-424b-b716-c73e28cc2ad9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.803805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7487a557-d944-424b-b716-c73e28cc2ad9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.803871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7487a557-d944-424b-b716-c73e28cc2ad9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.804838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7487a557-d944-424b-b716-c73e28cc2ad9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.804838] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7487a557-d944-424b-b716-c73e28cc2ad9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.307157] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7487a557-d944-424b-b716-c73e28cc2ad9 [ 970.307446] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.307594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.307677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.307925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.308052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.308188] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7487a557-d944-424b-b716-c73e28cc2ad9 already deleted. [ 970.308329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7487a557-d944-424b-b716-c73e28cc2ad9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.338829] env[69274]: INFO networking_nsxv3.common.synchronization [req-f414b906-200a-45aa-acce-eb71b785ab83 req-4618d766-8f2b-44ec-8d48-420a0329c7ee service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 970.339089] env[69274]: INFO networking_nsxv3.common.synchronization [req-f414b906-200a-45aa-acce-eb71b785ab83 req-4618d766-8f2b-44ec-8d48-420a0329c7ee service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 970.339260] env[69274]: INFO networking_nsxv3.common.synchronization [req-f414b906-200a-45aa-acce-eb71b785ab83 req-4618d766-8f2b-44ec-8d48-420a0329c7ee service nova] Enqueued Resource ID: f9ee9231-50b9-49d6-888b-451673c1dd27 with Priority: HIGHEST for action port [ 970.339823] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 970.339977] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 970.340218] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ee9231-50b9-49d6-888b-451673c1dd27 with Priority: HIGHEST for action port [ 970.340536] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.340710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.340845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.341106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.341233] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.342572] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.342865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.343012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9ee9231-50b9-49d6-888b-451673c1dd27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.343152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.343251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.343509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.343593] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ee9231-50b9-49d6-888b-451673c1dd27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.771871] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 970.772259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.772650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.772746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.773054] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.773211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.773318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.773486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.773608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.773703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.773801] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.775401] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a in Status: SUCCESS [ 970.776022] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a deletion is rescheduled due to dependency. [ 970.776022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.847028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.847028] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9ee9231-50b9-49d6-888b-451673c1dd27 with status ACTIVE [ 970.847028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.847028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.847028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.847537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.847537] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.847537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.847537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.847537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.847782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.847782] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9ee9231-50b9-49d6-888b-451673c1dd27 is going to be updated. [ 970.869982] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.870152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.870225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.870436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.870569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.870870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9ee9231-50b9-49d6-888b-451673c1dd27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.079012] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 971.079232] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 971.079347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.079503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.079726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.079909] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.080035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.080103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.080253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.080336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.080431] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.277249] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.277406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.277494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.277696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.277859] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.277965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.278050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.278206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.278294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.278383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.278527] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.278639] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.278700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.278865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.279017] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.279112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.279170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.279345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.279423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.279504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.279597] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.584501] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.774051] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe in Status: SUCCESS [ 971.774388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.774559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.774945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.775264] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.775435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.775528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.776016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.776143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.776246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.776361] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.781469] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 971.800041] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.800222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.800285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.800494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.800596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.800902] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.801064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.801138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.801246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.801326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.801508] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.801618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.801684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.801793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.801861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.802129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.802186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.802219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.802342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.802462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.802536] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 971.863848] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.864064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.864126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.864368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.864544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.878229] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 972.086532] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.279270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.279550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.279647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.279997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.280299] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.280485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.280642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.280875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.280989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.281103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.281269] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.281364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.284704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.284704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.284704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.284704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.284704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.284704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.284704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.284704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.284704] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.590996] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.590996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.590996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.590996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.590996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.590996] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 972.641849] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.642062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.642155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.642379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.643055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.655680] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 972.786489] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8176f39-b0b7-4ab1-9307-d82b36d10bfe: rpc.has_security_group_logging(os_id): False [ 972.807021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.807269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.807269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.807531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.807629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.807890] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.808031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.808108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.808270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.808347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.808553] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.808665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.808763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.808913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.808989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.809199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.809343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.809465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.809641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.809716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.809772] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe is going to be created. [ 972.883451] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.883668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.883744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.883997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.884211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.899043] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe in Status: IN_PROGRESS for 2s [ 972.933827] env[69274]: INFO networking_nsxv3.common.synchronization [req-7ccdf6e0-15a0-471e-a8ff-3142f60623cb req-0159dcc3-0ef9-4596-86da-5addd3d359fa tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 972.934510] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 972.935420] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.935567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.935631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.935838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.936068] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.936160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.936236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.936404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.936494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.936596] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.360461] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.360669] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.360836] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.361132] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.361392] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.361553] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.361674] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.361886] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.362046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.362260] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.362379] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.362496] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.362610] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.362726] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.362882] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.363101] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.384069] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.384069] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.384242] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.384406] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.384712] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-06b0cdfb-4964-4e16-8775-561c3849d654 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.384891] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.385030] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.385396] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.385546] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b0cdfb-4964-4e16-8775-561c3849d654',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.438549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.438774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.438881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.439205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.439336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.439614] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.439755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.439853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.440087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.440202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.440336] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 973.471955] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.472192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.472192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.472391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.472621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.483544] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 973.888096] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.888575] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.888575] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.888785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.888950] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.889143] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 06b0cdfb-4964-4e16-8775-561c3849d654 not found, creating... [ 973.889457] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.889639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.889788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.890042] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.890197] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.890502] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.890743] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.890869] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.891128] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.891308] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.891480] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 06b0cdfb-4964-4e16-8775-561c3849d654 is going to be created. [ 973.893342] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 973.893584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.918920] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.919199] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.919351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.919653] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.920010] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.920361] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.666800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 974.667054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.667234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.667480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.667723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.667815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.667852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.667981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.668101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.668195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.668421] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.694981] env[69274]: INFO networking_nsxv3.common.synchronization [req-7ccdf6e0-15a0-471e-a8ff-3142f60623cb req-c460102c-55fd-415c-b76c-c1214f4c93b5 service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 974.695217] env[69274]: INFO networking_nsxv3.common.synchronization [req-7ccdf6e0-15a0-471e-a8ff-3142f60623cb req-c460102c-55fd-415c-b76c-c1214f4c93b5 service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 974.695375] env[69274]: INFO networking_nsxv3.common.synchronization [req-7ccdf6e0-15a0-471e-a8ff-3142f60623cb req-c460102c-55fd-415c-b76c-c1214f4c93b5 service nova] Enqueued Resource ID: 06b0cdfb-4964-4e16-8775-561c3849d654 with Priority: HIGHEST for action port [ 974.695839] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 974.695980] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 974.697527] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0cdfb-4964-4e16-8775-561c3849d654 with Priority: HIGHEST for action port [ 974.697864] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.698042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.698151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.698381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.698489] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.699831] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.699943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.700275] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-06b0cdfb-4964-4e16-8775-561c3849d654 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.700387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.700455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.700651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.700735] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b0cdfb-4964-4e16-8775-561c3849d654',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.920667] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe in Status: SUCCESS [ 974.920667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.175588] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.175792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.175842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.176067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.176257] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.176335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.176414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.176579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.176672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.176806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.176974] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.177104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.177166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.177314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.177455] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.177537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.177600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.177743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.177838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.177924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.178024] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.200923] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.201167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.204502] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06b0cdfb-4964-4e16-8775-561c3849d654 with status ACTIVE [ 975.204715] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.204877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.204917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.205225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.205263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.205463] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.205569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.205633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.205795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.205875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.206077] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.206176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.206240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.206381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.206457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.206542] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06b0cdfb-4964-4e16-8775-561c3849d654 is going to be updated. [ 975.231238] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.231402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.231510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.231733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.231882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.232073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06b0cdfb-4964-4e16-8775-561c3849d654" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.495240] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 975.495413] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 deletion is rescheduled due to dependency. [ 975.495549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.495700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.495956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.496194] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.496308] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.496377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.496545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.496630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.496731] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.680671] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c216e0c6-b262-4569-8d09-772eeaa39501: rpc.has_security_group_logging(os_id): False [ 975.700267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.700434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.700775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.700885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.700960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.701304] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.701408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.701466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.701627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.701706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.701895] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.701989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.706166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.706371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.706675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.706779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.706983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.707057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.707090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.707172] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 975.772758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.772944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.773063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.773300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.773581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.789175] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 976.004999] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.507916] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.012305] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.012679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.012679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.012768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.014573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.014573] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 977.052443] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.052683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.052683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.053555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.053555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.065029] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 977.802821] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 977.802821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.030183] env[69274]: INFO networking_nsxv3.common.synchronization [req-900764e2-8c36-416a-beac-42110ffdfd30 req-04d89101-afba-4f4f-a15b-c444e9fa5759 tempest-ServerAddressesTestJSON-298088711 tempest-ServerAddressesTestJSON-298088711-project-member] Enqueued Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_members [ 979.031020] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGHEST for action security_group_members [ 979.032123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.032123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.032123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.032316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.032457] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.032594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.032684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.033813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.033813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.033813] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.083214] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 979.083214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.083214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.083214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.083214] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.083214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.083214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.083214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.083214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.083590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.083590] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.343938] env[69274]: INFO networking_nsxv3.common.synchronization [req-5db84c0c-9f41-47d8-ae82-13cabfcdd526 req-183fb2e3-7e94-4dac-9f9a-4df0d95ac3d7 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_members [ 979.344527] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_members [ 979.344828] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12f01d2-8146-4dc7-b376-a70f9bc9f697 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.344949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.345037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.345416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.345500] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.345581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.345631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.345777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.345853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.345949] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.535654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.536466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.536466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.536466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.536466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.536919] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.536919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.536919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.537446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.537446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.537446] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe is going to be updated. [ 979.568254] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.568541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.568541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.568703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.568843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.582154] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe in Status: IN_PROGRESS for 2s [ 979.586842] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.587050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.587134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.587348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.587530] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.587657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.587727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.587890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.587981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.588085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.588232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.588323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.588374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.588519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.588655] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.588747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.588811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.588986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.589112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.589219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.589343] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.714194] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.714194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.714401] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.714555] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.714888] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.715060] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.715200] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.715429] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.715583] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.715803] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.715927] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.716056] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.716173] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.716319] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.716471] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.716658] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.748313] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.748313] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.748313] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.748454] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.748692] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fa7ea63c-4767-49a2-a555-5f32632d3090 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.748874] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.749011] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.751812] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.751812] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7ea63c-4767-49a2-a555-5f32632d3090',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.848609] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.848833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.848915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.850017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.850017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.850017] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.850017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.850017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.850017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.850017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.850017] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 already deleted. [ 979.850552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.091695] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1ed1d16-c48a-4859-8659-45390ac1d1a8: rpc.has_security_group_logging(os_id): False [ 980.110313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.110447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.110536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.110758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.110899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.111102] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.111197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.111259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.111423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.111493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.111668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.111756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.111843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.111965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.112087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.112662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.112662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.112662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.112662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.112662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.113087] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 980.175323] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.175521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.175575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.175753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.175901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.194846] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 980.257245] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.257532] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.257754] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.258150] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.258356] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.258567] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port fa7ea63c-4767-49a2-a555-5f32632d3090 not found, creating... [ 980.258889] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.259137] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.259322] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.259606] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.259798] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.260254] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.260479] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.260636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.260918] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.261134] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.261329] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fa7ea63c-4767-49a2-a555-5f32632d3090 is going to be created. [ 980.286920] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.287172] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.287304] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.287602] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.287849] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.288117] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.021799] env[69274]: INFO networking_nsxv3.common.synchronization [req-5db84c0c-9f41-47d8-ae82-13cabfcdd526 req-1f75a165-2cbf-4982-a47b-dd60d83d9514 service nova] Enqueued Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_rules [ 981.021799] env[69274]: INFO networking_nsxv3.common.synchronization [req-5db84c0c-9f41-47d8-ae82-13cabfcdd526 req-1f75a165-2cbf-4982-a47b-dd60d83d9514 service nova] Enqueued Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_members [ 981.021799] env[69274]: INFO networking_nsxv3.common.synchronization [req-5db84c0c-9f41-47d8-ae82-13cabfcdd526 req-1f75a165-2cbf-4982-a47b-dd60d83d9514 service nova] Enqueued Resource ID: fa7ea63c-4767-49a2-a555-5f32632d3090 with Priority: HIGHEST for action port [ 981.021799] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_rules [ 981.021799] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_members [ 981.021799] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7ea63c-4767-49a2-a555-5f32632d3090 with Priority: HIGHEST for action port [ 981.021799] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.021799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.021799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.021799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.021799] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.021799] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12f01d2-8146-4dc7-b376-a70f9bc9f697 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.021799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.023536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.023536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.023536] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.023536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.023536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.023536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.023536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.023536] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.024539] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa7ea63c-4767-49a2-a555-5f32632d3090 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.024673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.024756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.025444] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.025444] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7ea63c-4767-49a2-a555-5f32632d3090',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.406755] env[69274]: INFO networking_nsxv3.common.synchronization [None req-4d66c408-f316-4b97-bd48-f5b31ee030ca tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_rules [ 981.407142] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_rules [ 981.407451] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e054c2da-0582-423b-9cca-a531d11f58d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.407581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.407652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.407939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.408038] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.513328] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3a8d90e6-4d1d-4449-b329-b0e06b31907a tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_rules [ 981.513899] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_rules [ 981.517267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e054c2da-0582-423b-9cca-a531d11f58d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.517549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.526611] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.527747] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12f01d2-8146-4dc7-b376-a70f9bc9f697 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.527898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.529251] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa7ea63c-4767-49a2-a555-5f32632d3090 with status ACTIVE [ 981.529477] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.529630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.529704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.529938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.530064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.530430] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.530430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.530572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.530649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.530841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.530957] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.531106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.531166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.531337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.531429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.531553] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa7ea63c-4767-49a2-a555-5f32632d3090 is going to be updated. [ 981.553879] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.554085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.554187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.554443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.554591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.554777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa7ea63c-4767-49a2-a555-5f32632d3090" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.594793] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe in Status: SUCCESS [ 981.594793] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe deletion is rescheduled due to dependency. [ 981.594793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.932460] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.932460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.932460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.932460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.932460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.932460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e054c2da-0582-423b-9cca-a531d11f58d2 already deleted. [ 981.932460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.932460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.932460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.932460] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.035864] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.210031] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 982.210031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.454949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.455388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.455388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.455594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.455736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.455892] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e054c2da-0582-423b-9cca-a531d11f58d2 already deleted. [ 982.456046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.540387] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.542027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.542027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.542027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.542027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.542027] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 is going to be created. [ 982.567127] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.567127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.567127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.567127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.567127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.574798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 in Status: UNINITIALIZED for 2s [ 984.588781] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 in Status: SUCCESS [ 984.589034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.589206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.589542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.589746] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.589869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.589935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.590108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.590194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.590274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.590365] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.607482] env[69274]: INFO networking_nsxv3.common.synchronization [req-23d080fe-2e88-404f-af48-6891f983285f req-48b2830f-af0f-40c6-9796-93d9e73fafc3 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_members [ 984.608557] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_members [ 984.608870] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.608995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.609092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.609351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.609505] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.609609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.609671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.609824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.609910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.610030] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.096490] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.113127] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.113127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.113127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.113545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.113545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.113545] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.113545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.113767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.113767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.113842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.113883] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc already deleted. [ 985.113992] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.134018] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.134242] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.134636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.134739] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.135020] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.135188] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.135378] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.135571] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.135725] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.135965] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.136097] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.136212] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.136327] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.136442] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.136552] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.136690] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.158125] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.158125] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 985.158125] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.158324] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.158661] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-361e72e8-2c28-481a-9114-df683cf9310c taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.158844] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.158973] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.159426] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.159588] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('361e72e8-2c28-481a-9114-df683cf9310c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.599481] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a12f01d2-8146-4dc7-b376-a70f9bc9f697: rpc.has_security_group_logging(os_id): False [ 985.620458] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.620663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.620804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.620986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.621383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.622264] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.622264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.622264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.622264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.622264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.622482] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 is going to be created. [ 985.662103] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.662103] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.662420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.662471] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.662669] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.662866] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 361e72e8-2c28-481a-9114-df683cf9310c not found, creating... [ 985.663414] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.663524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.663609] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.663853] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.664613] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.664613] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.664613] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.664859] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.665014] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.665271] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.665271] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 361e72e8-2c28-481a-9114-df683cf9310c is going to be created. [ 985.689234] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.689707] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.689920] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.693035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.693035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.693035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.725027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.725027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.725027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.725027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.725027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.737783] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 in Status: IN_PROGRESS for 2s [ 986.523234] env[69274]: INFO networking_nsxv3.common.synchronization [req-23d080fe-2e88-404f-af48-6891f983285f req-3f7fb76d-a631-454d-aba9-3200f21a0d6c service nova] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_rules [ 986.523234] env[69274]: INFO networking_nsxv3.common.synchronization [req-23d080fe-2e88-404f-af48-6891f983285f req-3f7fb76d-a631-454d-aba9-3200f21a0d6c service nova] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_members [ 986.523234] env[69274]: INFO networking_nsxv3.common.synchronization [req-23d080fe-2e88-404f-af48-6891f983285f req-3f7fb76d-a631-454d-aba9-3200f21a0d6c service nova] Enqueued Resource ID: 361e72e8-2c28-481a-9114-df683cf9310c with Priority: HIGHEST for action port [ 986.523234] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_rules [ 986.523596] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_members [ 986.523883] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361e72e8-2c28-481a-9114-df683cf9310c with Priority: HIGHEST for action port [ 986.524383] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.524673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.524969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.528074] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.528074] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.528074] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.528074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.528074] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.528833] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-361e72e8-2c28-481a-9114-df683cf9310c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.529124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.529319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.529610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.529814] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('361e72e8-2c28-481a-9114-df683cf9310c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.032976] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 361e72e8-2c28-481a-9114-df683cf9310c with status ACTIVE [ 987.032976] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.032976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.032976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.033705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.033705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.033705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.033705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.033705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.033964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.034044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.034217] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.034376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.034376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.034528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.034596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.034685] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 361e72e8-2c28-481a-9114-df683cf9310c is going to be updated. [ 987.035974] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.036266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.036615] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.059599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.059599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.059599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.059832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.060115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.060199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-361e72e8-2c28-481a-9114-df683cf9310c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.539411] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.749672] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 in Status: SUCCESS [ 987.750271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.042269] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.042667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.042667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.042741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.042826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.042999] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc is going to be created. [ 988.073904] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.074107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.074177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.074406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.074575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.087476] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: UNINITIALIZED for 2s [ 988.175246] env[69274]: INFO networking_nsxv3.common.synchronization [req-b89d7271-acb4-4c1a-a60a-9fc2bde6a9ec req-e6d5360d-c868-48c8-84ba-8ccc02f92825 tempest-MigrationsAdminTest-608694291 tempest-MigrationsAdminTest-608694291-project-member] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 988.175246] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGHEST for action security_group_members [ 988.175246] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.175246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.175246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.175246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.175246] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.175246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.175246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.175246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.175246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.175246] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.678033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.678233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.678329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.678570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.678691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.678937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.679094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.679191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.679401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.679752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.679752] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be updated. [ 988.730840] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.731103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.731285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.731658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.731934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.744817] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: IN_PROGRESS for 2s [ 990.100027] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: SUCCESS [ 990.100322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.100322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.100681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.100681] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.100848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.100975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.101564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.101677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.101747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.101834] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.607484] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.758094] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 in Status: SUCCESS [ 990.758394] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 deletion is rescheduled due to dependency. [ 990.758958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.111411] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75b08f22-c6d6-4014-88bf-a9fe927483cc: rpc.has_security_group_logging(os_id): False [ 991.133783] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.133977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.134075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.134390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.134533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.134780] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.134989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.134989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.135193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.135322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.135546] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc is going to be created. [ 991.208242] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.208242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.208242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.208242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.208242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.221625] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: IN_PROGRESS for 2s [ 993.036706] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c0099cb-cb94-4f8f-b44f-cf0108f10968 req-4bb5fed2-0d66-4734-93ae-95fe351d3f2a tempest-InstanceActionsV221TestJSON-386516287 tempest-InstanceActionsV221TestJSON-386516287-project-member] Enqueued Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_members [ 993.037304] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_members [ 993.037663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.037797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.037870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.038186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.040213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.040213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.040213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.040213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.040213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.040213] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.111023] env[69274]: INFO networking_nsxv3.common.synchronization [None req-5c7726fe-588b-4c5d-bcdd-73413da8f1bc None None] Enqueued Resource ID: 986cb951-18c3-4f74-b1e1-16b53d0f4837 with Priority: HIGHEST for action port [ 993.111023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986cb951-18c3-4f74-b1e1-16b53d0f4837 with Priority: HIGHEST for action port [ 993.111023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-986cb951-18c3-4f74-b1e1-16b53d0f4837 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.111023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-986cb951-18c3-4f74-b1e1-16b53d0f4837" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.111023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-986cb951-18c3-4f74-b1e1-16b53d0f4837" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.111023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-986cb951-18c3-4f74-b1e1-16b53d0f4837" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.111909] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986cb951-18c3-4f74-b1e1-16b53d0f4837',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.250860] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: SUCCESS [ 993.251802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.379149] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-115 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.379361] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-115" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.379492] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-115" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.379853] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-115" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.380127] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.380296] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.380420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.380643] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.380798] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.381039] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.381152] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.381270] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.381382] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.381502] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.381632] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.381739] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.402963] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.403188] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.403340] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.403538] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-115" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.403861] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-881c6f6e-fd2c-4406-b549-0416d78ff9fa taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.404125] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.404281] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.404613] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.404759] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('881c6f6e-fd2c-4406-b549-0416d78ff9fa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.542636] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.542867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.542930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.543159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.544199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.544199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.544199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.544199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.544199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.544199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.544199] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d already deleted. [ 993.544199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.614040] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 986cb951-18c3-4f74-b1e1-16b53d0f4837 [ 993.614300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.614454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.614520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.614739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.614836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.614942] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:986cb951-18c3-4f74-b1e1-16b53d0f4837 already deleted. [ 993.615041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-986cb951-18c3-4f74-b1e1-16b53d0f4837" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.907682] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.908125] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.908428] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.908894] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.909153] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.909344] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 881c6f6e-fd2c-4406-b549-0416d78ff9fa not found, creating... [ 993.909650] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.909828] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.909957] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.910298] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.910551] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.911042] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.911251] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.911381] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.911695] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.911894] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.912120] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 881c6f6e-fd2c-4406-b549-0416d78ff9fa is going to be created. [ 993.936820] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.937058] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.937124] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.937411] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.937690] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.937976] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.731894] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c0099cb-cb94-4f8f-b44f-cf0108f10968 req-2546297c-d0c2-4b29-96f9-321810dfced7 service nova] Enqueued Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_rules [ 994.731894] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c0099cb-cb94-4f8f-b44f-cf0108f10968 req-2546297c-d0c2-4b29-96f9-321810dfced7 service nova] Enqueued Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_members [ 994.731894] env[69274]: INFO networking_nsxv3.common.synchronization [req-5c0099cb-cb94-4f8f-b44f-cf0108f10968 req-2546297c-d0c2-4b29-96f9-321810dfced7 service nova] Enqueued Resource ID: 881c6f6e-fd2c-4406-b549-0416d78ff9fa with Priority: HIGHEST for action port [ 994.733518] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_rules [ 994.733518] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_members [ 994.733518] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881c6f6e-fd2c-4406-b549-0416d78ff9fa with Priority: HIGHEST for action port [ 994.733518] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.733518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.733518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.733518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.733518] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.734415] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.734986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.735079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.735270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.735434] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.735537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.735609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.735876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.735968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.736076] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.737586] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-881c6f6e-fd2c-4406-b549-0416d78ff9fa taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.737745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.737793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.737916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.737993] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('881c6f6e-fd2c-4406-b549-0416d78ff9fa',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.239115] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.239115] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.239232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.240803] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 881c6f6e-fd2c-4406-b549-0416d78ff9fa with status ACTIVE [ 995.241017] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.241182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.241260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.241479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.241839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.241839] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.241934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.242027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.242184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.242275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.242472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.242585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.242660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.242840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.242938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.243191] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 881c6f6e-fd2c-4406-b549-0416d78ff9fa is going to be updated. [ 995.276480] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.276632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.276683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.276957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.277127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.277290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-881c6f6e-fd2c-4406-b549-0416d78ff9fa" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.741090] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.841183] env[69274]: INFO networking_nsxv3.common.synchronization [None req-c61e51ef-1ed8-43a2-9524-932dba3ae2ff None None] Enqueued Resource ID: 32f11c42-a6cb-421a-b689-8e75bc477a92 with Priority: HIGHEST for action port [ 995.841755] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f11c42-a6cb-421a-b689-8e75bc477a92 with Priority: HIGHEST for action port [ 995.842297] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-32f11c42-a6cb-421a-b689-8e75bc477a92 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.842297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32f11c42-a6cb-421a-b689-8e75bc477a92" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.842499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32f11c42-a6cb-421a-b689-8e75bc477a92" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.842615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32f11c42-a6cb-421a-b689-8e75bc477a92" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.842697] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32f11c42-a6cb-421a-b689-8e75bc477a92',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.243347] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.243580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.243580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.243896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.243896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.244100] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d is going to be created. [ 996.269355] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.269640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.269640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.270025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.270141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.280116] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d in Status: UNINITIALIZED for 2s [ 996.345795] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32f11c42-a6cb-421a-b689-8e75bc477a92 [ 996.346061] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.346214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.346286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.346510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.346605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.346708] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32f11c42-a6cb-421a-b689-8e75bc477a92 already deleted. [ 996.346789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32f11c42-a6cb-421a-b689-8e75bc477a92" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.332327] env[69274]: INFO networking_nsxv3.common.synchronization [req-2c1dbb23-aaf2-4f6f-a42d-df78ec3dc144 req-505279fc-6cb5-4403-952b-ce0600ab7266 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 997.332600] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 997.334703] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.334703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.334703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.334703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.334703] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.334703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.334703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.334703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.334703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.334703] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.675792] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.676028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.676164] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.676449] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.676719] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.676880] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.677011] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.677255] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.677503] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.677646] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.677765] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.677883] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.677998] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.678130] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.678245] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.678380] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.704478] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.704662] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 997.704805] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.704996] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.705422] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-32a74156-7b4d-4d58-bccb-7ef7660b241b taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.705606] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.705742] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.706091] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.706263] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32a74156-7b4d-4d58-bccb-7ef7660b241b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.839038] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.210039] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.210039] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.210039] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.210039] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.210454] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.210454] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 32a74156-7b4d-4d58-bccb-7ef7660b241b not found, creating... [ 998.210765] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.210984] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.210984] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.211251] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.211386] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.211702] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.211865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.212034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.212275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.212418] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.212565] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 32a74156-7b4d-4d58-bccb-7ef7660b241b is going to be created. [ 998.233578] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.233862] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.233942] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.234311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.234568] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.234854] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.292354] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d in Status: SUCCESS [ 998.292663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.292862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.293196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.293407] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.293581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.293581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.293783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.293894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.293978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.294084] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.343202] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.796853] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.797101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.797216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.797562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.797793] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.797937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.798087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.798256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.798387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.798519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.798786] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.798945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.799049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.799249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.799443] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.799570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.799656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.799894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.800023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.800138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.800257] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.845457] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.845579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.845579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.845870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.845967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.846076] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 998.884287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.884469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.884514] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.884771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.884928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.906234] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 999.050991] env[69274]: INFO networking_nsxv3.common.synchronization [req-2c1dbb23-aaf2-4f6f-a42d-df78ec3dc144 req-63dd98e4-cca6-491d-ac56-d6dfde987bfc service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 999.051165] env[69274]: INFO networking_nsxv3.common.synchronization [req-2c1dbb23-aaf2-4f6f-a42d-df78ec3dc144 req-63dd98e4-cca6-491d-ac56-d6dfde987bfc service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 999.051324] env[69274]: INFO networking_nsxv3.common.synchronization [req-2c1dbb23-aaf2-4f6f-a42d-df78ec3dc144 req-63dd98e4-cca6-491d-ac56-d6dfde987bfc service nova] Enqueued Resource ID: 32a74156-7b4d-4d58-bccb-7ef7660b241b with Priority: HIGHEST for action port [ 999.051566] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 999.051704] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 999.051826] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32a74156-7b4d-4d58-bccb-7ef7660b241b with Priority: HIGHEST for action port [ 999.052359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.052485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.052601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.052743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.052823] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.054852] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.054852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.055069] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-32a74156-7b4d-4d58-bccb-7ef7660b241b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.055187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.055251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.055423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.055513] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32a74156-7b4d-4d58-bccb-7ef7660b241b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.302631] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dda0f1e4-d4a5-4ea2-b797-7489d5e4067d: rpc.has_security_group_logging(os_id): False [ 999.321749] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.321749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.321749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.321977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.321977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.322154] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.322284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.322351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.322491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.322584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.322762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.322861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.322935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.323108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.323202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.323385] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.323472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.323535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.323680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.323786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.324270] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d is going to be created. [ 999.388973] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.389397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.389397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.389475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.389680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.404892] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d in Status: IN_PROGRESS for 2s [ 999.560309] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.560309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.560309] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32a74156-7b4d-4d58-bccb-7ef7660b241b with status ACTIVE [ 999.560686] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.560686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.560686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.560994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.561133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.561321] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.561432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.561515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.561677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.561760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.562103] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.562103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.562230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.562309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.562486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.562855] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32a74156-7b4d-4d58-bccb-7ef7660b241b is going to be updated. [ 999.589539] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.589725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.589767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.590103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.590202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.590335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32a74156-7b4d-4d58-bccb-7ef7660b241b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.921627] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1000.922115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.922115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.922486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.922486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.922678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.922678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.924259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.924259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.924259] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.419330] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d in Status: SUCCESS [ 1001.420108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.429066] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.933637] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.433637] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.436482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.436482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.436482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.436482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.436482] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1002.474391] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.474602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.474658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.474874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.476047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.488444] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1004.057988] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1004.057988] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1004.557336] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1004.557336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.557336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.557336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.557811] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.558013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.558101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.558391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.558391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.558649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.558793] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.063570] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.063950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.063950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.064192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.064465] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.064638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.064748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.065011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.065177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.065333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.065547] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.065652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.065716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.065867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.066033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.066154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.066197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.066335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.067030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.067030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.067030] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.568758] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 1005.590587] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.590776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.590820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.591043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.591145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.591374] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.591480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.591545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.591706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.591786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.591969] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.592079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.592144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.592292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.592361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.592549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.592652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.592697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.592837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.592911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.593013] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1005.663552] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.663825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.663825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.664074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.664586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.686169] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1005.972696] env[69274]: INFO networking_nsxv3.common.synchronization [req-a606637c-b674-49f4-a481-5ccd014fcb3b req-94c77e71-39c8-4349-bdff-51a03b5f5da4 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_members [ 1005.973653] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_members [ 1005.973653] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e054c2da-0582-423b-9cca-a531d11f58d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.973909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.973909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.974105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.974266] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.974371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.974431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.974586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.974671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.974861] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.351101] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.351568] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.352273] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.352594] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.352870] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.353065] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.353276] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.353522] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.353679] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.353899] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.354172] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.354172] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.354348] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.354348] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.354476] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.354603] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.375846] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.376014] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.376116] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.376487] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.376875] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fb692efc-7774-48ce-a88c-c64ece6343a5 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.377216] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.377216] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.377627] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.377776] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb692efc-7774-48ce-a88c-c64ece6343a5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.477328] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.477562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.477604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.477832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.477926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.478142] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.478244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.478309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.478467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.478544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.479576] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e054c2da-0582-423b-9cca-a531d11f58d2 already deleted. [ 1006.480466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.884437] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.885299] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.885474] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.885774] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.885938] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.886168] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port fb692efc-7774-48ce-a88c-c64ece6343a5 not found, creating... [ 1006.886425] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.886625] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.886703] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.886999] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.887113] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.887420] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.887571] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.888050] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.888401] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.888447] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.888752] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fb692efc-7774-48ce-a88c-c64ece6343a5 is going to be created. [ 1006.900291] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3efc8d07-c9be-480c-8dcf-280f4f5a6ef8 None None] Enqueued Resource ID: f5bb0c96-4466-4081-8234-1b54a9f1218a with Priority: HIGHEST for action port [ 1006.902126] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5bb0c96-4466-4081-8234-1b54a9f1218a with Priority: HIGHEST for action port [ 1006.902508] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5bb0c96-4466-4081-8234-1b54a9f1218a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.902508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5bb0c96-4466-4081-8234-1b54a9f1218a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.902508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5bb0c96-4466-4081-8234-1b54a9f1218a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.906019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5bb0c96-4466-4081-8234-1b54a9f1218a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.906019] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5bb0c96-4466-4081-8234-1b54a9f1218a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.912907] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.912907] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.912907] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.912907] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.913330] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.914187] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.407085] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5bb0c96-4466-4081-8234-1b54a9f1218a [ 1007.408756] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.408756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.408756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.408756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.408756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.408756] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5bb0c96-4466-4081-8234-1b54a9f1218a already deleted. [ 1007.408756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5bb0c96-4466-4081-8234-1b54a9f1218a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.703617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1007.703617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.812175] env[69274]: INFO networking_nsxv3.common.synchronization [None req-d4da6d18-fd3c-4cea-a786-b70db4eb34ee tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_rules [ 1007.812175] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_rules [ 1007.812703] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.812703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.812703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.814287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.814287] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.870341] env[69274]: INFO networking_nsxv3.common.synchronization [req-a606637c-b674-49f4-a481-5ccd014fcb3b req-cb921aea-3d18-4011-84be-9fe8d67a6079 service nova] Enqueued Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_rules [ 1007.870422] env[69274]: INFO networking_nsxv3.common.synchronization [req-a606637c-b674-49f4-a481-5ccd014fcb3b req-cb921aea-3d18-4011-84be-9fe8d67a6079 service nova] Enqueued Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_members [ 1007.871633] env[69274]: INFO networking_nsxv3.common.synchronization [req-a606637c-b674-49f4-a481-5ccd014fcb3b req-cb921aea-3d18-4011-84be-9fe8d67a6079 service nova] Enqueued Resource ID: fb692efc-7774-48ce-a88c-c64ece6343a5 with Priority: HIGHEST for action port [ 1007.871633] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_rules [ 1007.871633] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_members [ 1007.871633] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb692efc-7774-48ce-a88c-c64ece6343a5 with Priority: HIGHEST for action port [ 1007.871781] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e054c2da-0582-423b-9cca-a531d11f58d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.871841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.871911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.872127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.872251] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.873232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e054c2da-0582-423b-9cca-a531d11f58d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.873437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.873437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.873617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.873768] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.873866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.873960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.874100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.874224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.874277] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.880940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb692efc-7774-48ce-a88c-c64ece6343a5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.880940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.880940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.880940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.880940] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb692efc-7774-48ce-a88c-c64ece6343a5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.934754] env[69274]: INFO networking_nsxv3.common.synchronization [None req-4f8144bb-350e-4e4a-a5af-bb45bdf39105 tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_rules [ 1007.935302] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_rules [ 1007.935623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.936333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.336549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.336549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.336549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.336812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.336812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.336893] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 already deleted. [ 1008.337053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.339612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.339612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.339612] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.386093] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e054c2da-0582-423b-9cca-a531d11f58d2 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.386262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.386473] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.387375] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb692efc-7774-48ce-a88c-c64ece6343a5 with status ACTIVE [ 1008.387555] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.387711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.387779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.387987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.388097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.388276] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.388374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.392034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.392034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.392034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.392034] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.392034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.392034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.392034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.392034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.392034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb692efc-7774-48ce-a88c-c64ece6343a5 is going to be updated. [ 1008.420686] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.421138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.421138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.421219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.421601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.421601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb692efc-7774-48ce-a88c-c64ece6343a5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.694372] env[69274]: INFO networking_nsxv3.common.synchronization [req-e41f5d7b-16f8-4895-b05b-f92b89d7341a req-3fa86126-fe7e-4097-9e9e-f39589a6515c tempest-InstanceActionsV221TestJSON-386516287 tempest-InstanceActionsV221TestJSON-386516287-project-member] Enqueued Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_members [ 1008.694481] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGHEST for action security_group_members [ 1008.694888] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.694888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.694888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.695184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.695273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.695376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.695440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.695592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.695680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.695775] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.868431] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.868431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.868431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.868431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.868431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.868431] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 already deleted. [ 1008.868431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.894244] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.198393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.198724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.198838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.199020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.199147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.199369] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.199496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.199590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.200432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.200432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.200432] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d is going to be updated. [ 1009.231080] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.231312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.231366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.231575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.231990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.246704] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d in Status: IN_PROGRESS for 2s [ 1009.269217] env[69274]: INFO networking_nsxv3.common.synchronization [None req-d3f2a0f9-46ca-4fff-8861-7b3330428c55 None None] Enqueued Resource ID: abafcecf-388a-4387-ba02-1b293a80a270 with Priority: HIGHEST for action port [ 1009.269792] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abafcecf-388a-4387-ba02-1b293a80a270 with Priority: HIGHEST for action port [ 1009.270541] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-abafcecf-388a-4387-ba02-1b293a80a270 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.272105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abafcecf-388a-4387-ba02-1b293a80a270" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.272105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abafcecf-388a-4387-ba02-1b293a80a270" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.272105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abafcecf-388a-4387-ba02-1b293a80a270" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.272105] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abafcecf-388a-4387-ba02-1b293a80a270',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.398372] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.398843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.399009] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.399251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.399352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.399460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e054c2da-0582-423b-9cca-a531d11f58d2 is going to be created. [ 1009.426145] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.426626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.426626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.426626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.426817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.439175] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e054c2da-0582-423b-9cca-a531d11f58d2 in Status: UNINITIALIZED for 2s [ 1009.773784] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abafcecf-388a-4387-ba02-1b293a80a270 [ 1009.773784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.773784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.773784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.774041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.774041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.774041] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abafcecf-388a-4387-ba02-1b293a80a270 already deleted. [ 1009.774179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abafcecf-388a-4387-ba02-1b293a80a270" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.004823] env[69274]: INFO networking_nsxv3.common.synchronization [req-d484fdbd-3454-4dca-a688-24a8f8b3daa6 req-f96dcb01-b664-4a40-95b5-f217ea8b1412 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1010.005591] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1010.005961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.006212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.006329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.006554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.006709] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.006813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.006877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.007042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.007136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.007230] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.418593] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.418832] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.418974] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.419335] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.419629] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.419799] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.419927] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.420174] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.420334] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.420551] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.420673] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.420802] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.420968] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.421143] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.421286] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.421463] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.440320] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.440659] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.440659] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.440833] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.441407] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.441407] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.441624] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.441900] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.442045] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec65203-d9fb-41f7-9bd7-caf3bf9d2bed',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.509388] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.509517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.509653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.509853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.510031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.510513] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.510513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.510513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.510513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.510513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.510747] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1010.536640] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.536836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.536891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.537503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.537503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.549176] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1010.944214] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.944471] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.944628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.944923] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.945110] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.945280] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port bec65203-d9fb-41f7-9bd7-caf3bf9d2bed not found, creating... [ 1010.945585] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.945756] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.945884] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.946132] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.946278] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.946625] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.946842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.946972] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.947248] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.947368] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.947507] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: bec65203-d9fb-41f7-9bd7-caf3bf9d2bed is going to be created. [ 1010.972266] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.973057] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.973057] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.973243] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.974067] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.974067] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.259781] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d in Status: SUCCESS [ 1011.260011] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d deletion is rescheduled due to dependency. [ 1011.260146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.452822] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e054c2da-0582-423b-9cca-a531d11f58d2 in Status: SUCCESS [ 1011.453193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.453655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.453870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.454098] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.454224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.454278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.454441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.454511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.454604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.454697] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.721885] env[69274]: INFO networking_nsxv3.common.synchronization [req-d484fdbd-3454-4dca-a688-24a8f8b3daa6 req-e1ed73a7-e08e-460a-b5f0-2ed3b214d40b service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1011.722192] env[69274]: INFO networking_nsxv3.common.synchronization [req-d484fdbd-3454-4dca-a688-24a8f8b3daa6 req-e1ed73a7-e08e-460a-b5f0-2ed3b214d40b service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1011.722380] env[69274]: INFO networking_nsxv3.common.synchronization [req-d484fdbd-3454-4dca-a688-24a8f8b3daa6 req-e1ed73a7-e08e-460a-b5f0-2ed3b214d40b service nova] Enqueued Resource ID: bec65203-d9fb-41f7-9bd7-caf3bf9d2bed with Priority: HIGHEST for action port [ 1011.722940] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1011.723119] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1011.723250] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec65203-d9fb-41f7-9bd7-caf3bf9d2bed with Priority: HIGHEST for action port [ 1011.723528] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.723717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.723717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.723902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.723982] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.724903] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.724968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.725277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.725407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.725441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.725905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.725905] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec65203-d9fb-41f7-9bd7-caf3bf9d2bed',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.957871] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.090737] env[69274]: INFO networking_nsxv3.common.synchronization [req-32df0c41-97e8-44a5-a3be-d1f52ecff9be req-c1bb550d-f97d-4361-88f0-ff614e4b86f4 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1012.090737] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1012.090737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.090737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.090737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.090737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.090737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.090737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.090737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.090737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.090737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.090737] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.223793] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1012.223793] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:2 started [ 1012.227419] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.227572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.229025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bec65203-d9fb-41f7-9bd7-caf3bf9d2bed with status ACTIVE [ 1012.229025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.229025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.229218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.229499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.229499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.229573] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.229678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.229733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.230059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.230164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.230439] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.230550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.230620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.230941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.230941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.230941] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bec65203-d9fb-41f7-9bd7-caf3bf9d2bed is going to be updated. [ 1012.253625] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.253797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.253877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.254142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.254295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.254464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bec65203-d9fb-41f7-9bd7-caf3bf9d2bed" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.461167] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e054c2da-0582-423b-9cca-a531d11f58d2: rpc.has_security_group_logging(os_id): False [ 1012.484183] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.484317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.484413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.484620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.484717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.485068] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.485206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.485284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.485485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.485578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.485687] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e054c2da-0582-423b-9cca-a531d11f58d2 is going to be created. [ 1012.564163] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1012.564368] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1012.564451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.564626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.564853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.565047] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.565299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.565299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.565419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.565513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.565614] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.568616] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.568616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.568616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.568926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.568926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.576672] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.582688] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e054c2da-0582-423b-9cca-a531d11f58d2 in Status: IN_PROGRESS for 2s [ 1013.068156] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.083044] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.570487] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.587910] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.587910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.587910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.587910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.587910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.587910] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1013.616986] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.617229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.617308] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.617584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.617833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.629549] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1014.072646] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.072808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.072883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.073202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.073323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.073463] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1014.107505] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.109037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.109037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.109037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.109037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.117085] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1014.376153] env[69274]: INFO networking_nsxv3.common.synchronization [None req-de9ff552-b02e-468c-a953-72c337bfcbad None None] Enqueued Resource ID: 649b6b9b-a742-4ce5-b7a3-3c72996f3708 with Priority: HIGHEST for action port [ 1014.377422] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 649b6b9b-a742-4ce5-b7a3-3c72996f3708 with Priority: HIGHEST for action port [ 1014.378683] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-649b6b9b-a742-4ce5-b7a3-3c72996f3708 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.378897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-649b6b9b-a742-4ce5-b7a3-3c72996f3708" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.379024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-649b6b9b-a742-4ce5-b7a3-3c72996f3708" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.379330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-649b6b9b-a742-4ce5-b7a3-3c72996f3708" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.379484] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('649b6b9b-a742-4ce5-b7a3-3c72996f3708',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.597308] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e054c2da-0582-423b-9cca-a531d11f58d2 in Status: SUCCESS [ 1014.597585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.885776] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 649b6b9b-a742-4ce5-b7a3-3c72996f3708 [ 1014.886033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.886289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.886289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.886493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.886535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.886608] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:649b6b9b-a742-4ce5-b7a3-3c72996f3708 already deleted. [ 1014.886772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-649b6b9b-a742-4ce5-b7a3-3c72996f3708" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.643038] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1015.643448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.128868] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1016.129279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.129568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.129825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.130053] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.130195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.130274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.130450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.130571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.130680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.130778] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.597437] env[69274]: INFO networking_nsxv3.common.synchronization [None req-63fa8656-1247-4d00-b9cb-377aa265423a None None] Enqueued Resource ID: 1c3a334f-0d45-4e08-9148-32cb8b3ebdba with Priority: HIGHEST for action port [ 1016.597797] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c3a334f-0d45-4e08-9148-32cb8b3ebdba with Priority: HIGHEST for action port [ 1016.598269] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c3a334f-0d45-4e08-9148-32cb8b3ebdba taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.598391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c3a334f-0d45-4e08-9148-32cb8b3ebdba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.598455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c3a334f-0d45-4e08-9148-32cb8b3ebdba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.598737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c3a334f-0d45-4e08-9148-32cb8b3ebdba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.598785] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c3a334f-0d45-4e08-9148-32cb8b3ebdba',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.634784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.635015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.635142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.635438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.635673] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.635818] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.635930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.636235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.636405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.636551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.636764] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.636902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.637020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.637204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.637494] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.637494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.637494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.637681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.637719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.637798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.638346] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.100998] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c3a334f-0d45-4e08-9148-32cb8b3ebdba [ 1017.101356] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.102469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.102469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.102469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.102469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.102469] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c3a334f-0d45-4e08-9148-32cb8b3ebdba already deleted. [ 1017.102469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c3a334f-0d45-4e08-9148-32cb8b3ebdba" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.140141] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf62572c-aed8-4405-8e2e-513d1f9f3976: rpc.has_security_group_logging(os_id): False [ 1017.158238] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.158382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.158455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.158671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.158766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.158985] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.159115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.159154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.159299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.159378] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.159551] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.159643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.159706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.159844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.159920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.160130] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.160226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.160291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.160427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.160504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.160586] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1017.312756] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.314824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.314950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.315265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.315473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.331309] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1018.093458] env[69274]: INFO networking_nsxv3.common.synchronization [req-fe5f9181-e613-40f6-829e-270583d3ec45 req-01e5f8c2-a26d-4dee-b9eb-8616dd606970 tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1018.094436] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1018.094436] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.094605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.094605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.094875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.094986] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.095553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.095553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.095553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.095700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.095700] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.598480] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.598834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.598834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.599039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.599163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.599394] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.599516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.599574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.599759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.599845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.599984] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1018.637994] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.637994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.637994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.637994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.637994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.649231] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1018.872524] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.872524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.872524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.873085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.873556] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.873892] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.874169] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.874574] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.876025] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.876025] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.876025] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.876025] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.876025] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.876025] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.876025] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.876025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.897021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.897021] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.897021] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.897021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.897021] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-825b76dc-5755-4c72-9288-62d7ab4401e8 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.897021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.897021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.897021] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.897021] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('825b76dc-5755-4c72-9288-62d7ab4401e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.347077] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1019.347367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.401093] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.401967] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.402498] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.402562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.402675] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.402848] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 825b76dc-5755-4c72-9288-62d7ab4401e8 not found, creating... [ 1019.403242] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.403413] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.403545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.403801] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.403950] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.404376] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.404562] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.404689] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.404913] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.405068] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.405219] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 825b76dc-5755-4c72-9288-62d7ab4401e8 is going to be created. [ 1019.425646] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.426028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.426028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.426787] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.426787] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.426787] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.217322] env[69274]: INFO networking_nsxv3.common.synchronization [req-fe5f9181-e613-40f6-829e-270583d3ec45 req-f39f2150-47cd-4bbd-9519-32272e41f2ee service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 1020.217549] env[69274]: INFO networking_nsxv3.common.synchronization [req-fe5f9181-e613-40f6-829e-270583d3ec45 req-f39f2150-47cd-4bbd-9519-32272e41f2ee service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1020.217653] env[69274]: INFO networking_nsxv3.common.synchronization [req-fe5f9181-e613-40f6-829e-270583d3ec45 req-f39f2150-47cd-4bbd-9519-32272e41f2ee service nova] Enqueued Resource ID: 825b76dc-5755-4c72-9288-62d7ab4401e8 with Priority: HIGHEST for action port [ 1020.221761] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 1020.221940] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1020.222164] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825b76dc-5755-4c72-9288-62d7ab4401e8 with Priority: HIGHEST for action port [ 1020.223502] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.223655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.223728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.223943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.224052] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.226581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.226687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.226898] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-825b76dc-5755-4c72-9288-62d7ab4401e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.227017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.227125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.227314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.227399] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('825b76dc-5755-4c72-9288-62d7ab4401e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.375258] env[69274]: INFO networking_nsxv3.common.synchronization [req-27ceae9c-d09d-469e-9d2d-e8aeb36c9d2f req-77e762f4-e001-4924-8c6b-6f0417b221d2 tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1020.375687] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1020.375687] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.375833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.375877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.376084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.376246] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.376350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.376442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.376584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.376711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.376815] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.660974] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1020.661189] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 deletion is rescheduled due to dependency. [ 1020.661310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.661484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.661700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.661890] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.662016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.662080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.662240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.662327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.662422] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.718281] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.718491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.718622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.718975] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.719493] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.719763] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.719896] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.720151] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.720331] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.720515] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.720638] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.720757] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.720940] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.721117] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.721253] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.721396] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.727583] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.727712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.728984] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 825b76dc-5755-4c72-9288-62d7ab4401e8 with status ACTIVE [ 1020.729163] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.729273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.729340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.729531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.729598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.729864] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.729940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.730027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.730237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.730335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.730595] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.730696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.730760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.730965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.731068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.731176] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 825b76dc-5755-4c72-9288-62d7ab4401e8 is going to be updated. [ 1020.740745] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.740934] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1020.741096] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.741309] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.741627] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.741804] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.741931] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.742306] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.742421] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a8a7bd9-f7b7-4161-ad9a-d846e730a445',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.754596] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.754699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.754766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.754986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.755866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.755866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-825b76dc-5755-4c72-9288-62d7ab4401e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.879946] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.165744] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.245974] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.246345] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.246413] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.246693] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.246865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.247054] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 5a8a7bd9-f7b7-4161-ad9a-d846e730a445 not found, creating... [ 1021.247337] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.247513] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.247642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.247876] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.248043] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.248343] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.248511] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.248644] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.248868] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.249026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.249183] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 5a8a7bd9-f7b7-4161-ad9a-d846e730a445 is going to be created. [ 1021.270737] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.271056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.271315] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.271583] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.271723] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.271955] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.385816] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.668631] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.885810] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.886024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.886119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.886442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.886989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.886989] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1021.916726] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.916949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.917066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.917364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.917603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.929649] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1022.022711] env[69274]: INFO networking_nsxv3.common.synchronization [req-27ceae9c-d09d-469e-9d2d-e8aeb36c9d2f req-67e98c6d-7ffb-47b6-96cc-00d343b6eef0 service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 1022.022919] env[69274]: INFO networking_nsxv3.common.synchronization [req-27ceae9c-d09d-469e-9d2d-e8aeb36c9d2f req-67e98c6d-7ffb-47b6-96cc-00d343b6eef0 service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1022.023120] env[69274]: INFO networking_nsxv3.common.synchronization [req-27ceae9c-d09d-469e-9d2d-e8aeb36c9d2f req-67e98c6d-7ffb-47b6-96cc-00d343b6eef0 service nova] Enqueued Resource ID: 5a8a7bd9-f7b7-4161-ad9a-d846e730a445 with Priority: HIGHEST for action port [ 1022.023722] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 1022.023865] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1022.023967] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8a7bd9-f7b7-4161-ad9a-d846e730a445 with Priority: HIGHEST for action port [ 1022.028574] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.028736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.028809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.029039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.029131] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.030231] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.030333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.030619] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.030746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.030841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.034222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.034327] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a8a7bd9-f7b7-4161-ad9a-d846e730a445',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.171300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.171436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.171569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.172073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.172073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.172073] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1022.202368] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.202922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.203015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.203305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.203517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.221545] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1022.537305] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a8a7bd9-f7b7-4161-ad9a-d846e730a445 with status ACTIVE [ 1022.537590] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.537721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.537790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.537999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.538110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.538308] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.538485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.538485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.538588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.538674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.538856] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.538955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.539025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.539180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.539251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.539375] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a8a7bd9-f7b7-4161-ad9a-d846e730a445 is going to be updated. [ 1022.540490] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.540630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.560387] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.560536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.560638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.560810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.560951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.561138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a8a7bd9-f7b7-4161-ad9a-d846e730a445" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.943050] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1023.943464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.944032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.944032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.944236] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.944406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.944533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.944802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.944950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.945144] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.231375] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1024.231648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.231873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.232149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.232352] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.232468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.232538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.232683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.232765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.232847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.232949] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.448111] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.735747] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.951081] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.240552] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15291f2b-281c-4bf0-a609-bcb369c82f51: rpc.has_security_group_logging(os_id): False [ 1025.265027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.265027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.265027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.265027] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1025.341477] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.341641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.341673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.341892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.342082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.354991] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1025.455748] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.455931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.456018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.456240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.456340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.456449] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1025.501083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.501345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.501532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.502786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.502786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.515167] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1027.025327] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1027.025792] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1027.178500] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca3f2323-76cd-4003-883a-73a5639e8415 req-08b8ebba-b1ff-4784-93ec-2ed13441a05d tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_members [ 1027.178820] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_members [ 1027.179159] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.179291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.179350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.179600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.179819] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.179901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.179958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.181179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.181179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.181179] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.369840] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1027.370199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.526207] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1027.526207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.526207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.526443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.526565] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.526769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.526769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.526939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.527035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.527123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.527213] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.531423] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.531636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.531771] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.532193] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.532921] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.533148] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.533351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.533579] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.533742] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.533980] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.534119] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.534422] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.534422] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.534521] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.534668] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.534816] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.556208] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.557251] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.557251] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.557251] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.557251] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-a457f8fa-93c2-41e2-849d-58127badf365 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.557251] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.557251] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.558847] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.558847] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a457f8fa-93c2-41e2-849d-58127badf365',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.685916] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.686092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.686169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.686411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.686511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.686710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.686825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.686875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.687028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.687109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.687194] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 already deleted. [ 1027.687278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.034119] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.034119] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.034119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.034119] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.034694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.034694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.034694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.034694] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.034839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.034900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.035128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.035258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.035390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.035526] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.060751] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.061051] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.061208] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.061509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.061784] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.061852] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port a457f8fa-93c2-41e2-849d-58127badf365 not found, creating... [ 1028.062158] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.062336] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.062462] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.062770] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.062887] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.063449] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.063685] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.063851] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.064216] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.064380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.064597] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: a457f8fa-93c2-41e2-849d-58127badf365 is going to be created. [ 1028.090893] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.090893] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.090893] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.090893] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.091180] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.091356] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.539623] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1ed1d16-c48a-4859-8659-45390ac1d1a8: rpc.has_security_group_logging(os_id): False [ 1028.563934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.564116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.564116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.564590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.564590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.564765] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.564913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.564949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.565196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.565316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.565919] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.566504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.566504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.566504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.566504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.566984] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.567171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.567230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.567500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.567500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.567861] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1028.635662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.635662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.635662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.636596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.636596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.654179] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1028.894668] env[69274]: INFO networking_nsxv3.common.synchronization [None req-fadc2740-f685-4547-be10-a2a30bf78163 None None] Enqueued Resource ID: 5ed13a5e-ace8-4885-86a0-7696f94cff16 with Priority: HIGHEST for action port [ 1028.895766] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ed13a5e-ace8-4885-86a0-7696f94cff16 with Priority: HIGHEST for action port [ 1028.896390] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ed13a5e-ace8-4885-86a0-7696f94cff16 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.898926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ed13a5e-ace8-4885-86a0-7696f94cff16" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.898926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ed13a5e-ace8-4885-86a0-7696f94cff16" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.898926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ed13a5e-ace8-4885-86a0-7696f94cff16" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.898926] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed13a5e-ace8-4885-86a0-7696f94cff16',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.401072] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ed13a5e-ace8-4885-86a0-7696f94cff16 [ 1029.402470] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.402470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.402470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.402470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.402470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.402470] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ed13a5e-ace8-4885-86a0-7696f94cff16 already deleted. [ 1029.402470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ed13a5e-ace8-4885-86a0-7696f94cff16" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.503836] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca3f2323-76cd-4003-883a-73a5639e8415 req-a1257ab3-483f-493b-af66-f322dc102f07 service nova] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_rules [ 1029.504036] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca3f2323-76cd-4003-883a-73a5639e8415 req-a1257ab3-483f-493b-af66-f322dc102f07 service nova] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_members [ 1029.504184] env[69274]: INFO networking_nsxv3.common.synchronization [req-ca3f2323-76cd-4003-883a-73a5639e8415 req-a1257ab3-483f-493b-af66-f322dc102f07 service nova] Enqueued Resource ID: a457f8fa-93c2-41e2-849d-58127badf365 with Priority: HIGHEST for action port [ 1029.504748] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_rules [ 1029.504889] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_members [ 1029.504978] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a457f8fa-93c2-41e2-849d-58127badf365 with Priority: HIGHEST for action port [ 1029.506427] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.506566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.506626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.506886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.506969] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.507860] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.507985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.508068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.511481] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.511481] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.511481] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a457f8fa-93c2-41e2-849d-58127badf365 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.511481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.511481] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a457f8fa-93c2-41e2-849d-58127badf365',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.012330] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.012330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.012565] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.015398] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a457f8fa-93c2-41e2-849d-58127badf365 with status ACTIVE [ 1030.015608] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.015756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.015929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.016162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.016199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.016407] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.016492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.016552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.016724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.016837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.017009] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.017138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.017193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.017302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.017381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.017470] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a457f8fa-93c2-41e2-849d-58127badf365 is going to be updated. [ 1030.046866] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.046866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.046866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.047401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.047401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.047588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a457f8fa-93c2-41e2-849d-58127badf365" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.515214] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.551688] env[69274]: INFO networking_nsxv3.common.synchronization [req-4a9e2704-ebbc-4065-b974-f86f15e2321d req-723a42a8-8c29-4e6d-9885-acd7085351e6 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_members [ 1030.552356] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 with Priority: HIGHEST for action security_group_members [ 1030.552719] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-a12f01d2-8146-4dc7-b376-a70f9bc9f697 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.552852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.552951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.553223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.557043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.557043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.557043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.557043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.557043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.557043] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a12f01d2-8146-4dc7-b376-a70f9bc9f697',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.678195] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1030.678195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.018861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.019303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.019303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.019303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.019507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.019563] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 is going to be created. [ 1031.052223] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.052439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.052809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.052809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.052921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.061020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.061220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.061281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.061478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.061577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.061795] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.061923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.061991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.062171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.062254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.062348] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 is going to be updated. [ 1031.066377] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: UNINITIALIZED for 2s [ 1031.098379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.098602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.098698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.099111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.099345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.109540] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 in Status: IN_PROGRESS for 2s [ 1031.561655] env[69274]: INFO networking_nsxv3.common.synchronization [req-7308e853-e1b1-4507-bf9d-b41c852c6bf3 req-691ee28f-c097-4d72-a07a-b604586f0b85 tempest-ServerRescueTestJSON-2125380106 tempest-ServerRescueTestJSON-2125380106-project-member] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1031.561655] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1031.562405] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.565719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.565719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.565719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.565719] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.566452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.566551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.566807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.566900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.567255] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.861999] env[69274]: INFO networking_nsxv3.common.synchronization [None req-55aa9b61-24d6-4e82-b50b-204409ef62f8 None None] Enqueued Resource ID: 9cc9f380-ea1f-4f77-9970-32cd5b3b141b with Priority: HIGHEST for action port [ 1031.862846] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc9f380-ea1f-4f77-9970-32cd5b3b141b with Priority: HIGHEST for action port [ 1031.864305] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc9f380-ea1f-4f77-9970-32cd5b3b141b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.864492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc9f380-ea1f-4f77-9970-32cd5b3b141b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.864636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc9f380-ea1f-4f77-9970-32cd5b3b141b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.865111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc9f380-ea1f-4f77-9970-32cd5b3b141b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.865775] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc9f380-ea1f-4f77-9970-32cd5b3b141b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.070974] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.071253] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.071433] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.072392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.072792] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.072999] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.073143] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.073536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.073654] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.073908] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.074045] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.074191] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.074316] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.074470] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.074610] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.074759] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.077715] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.077868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.077925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.078154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.078249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.078424] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.078523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.078616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.078832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.078923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.079090] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d already deleted. [ 1032.079199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.103022] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.103022] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.103022] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.103022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.103022] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.103022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.103022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.103022] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.103022] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a0a431-85d4-4698-8d8e-c2d089c1f7f4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.368892] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cc9f380-ea1f-4f77-9970-32cd5b3b141b [ 1032.369185] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.369342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.369418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.369659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.369784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.369937] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cc9f380-ea1f-4f77-9970-32cd5b3b141b already deleted. [ 1032.370104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc9f380-ea1f-4f77-9970-32cd5b3b141b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.566722] env[69274]: INFO networking_nsxv3.common.synchronization [req-f94f2d4a-792c-4104-97c2-ec1a209f0071 req-fc2b8ebe-1fa6-43a9-88c6-28847f85b6cd tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1032.567285] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1032.567593] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.567718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.567786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.568172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.568371] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.568476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.568541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.568699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.568785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.568879] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.604928] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.605351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.605539] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.606067] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.606243] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.606447] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 08a0a431-85d4-4698-8d8e-c2d089c1f7f4 not found, creating... [ 1032.607380] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.607380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.607380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.607380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.607603] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.610034] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.610034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.610034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.610034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.610034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.610034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 08a0a431-85d4-4698-8d8e-c2d089c1f7f4 is going to be created. [ 1032.631828] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.632094] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.632229] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.632516] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.632755] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.632994] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.071098] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.077728] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: SUCCESS [ 1033.077975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.078417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.078501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.078724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.078979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.078979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.079168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.079282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.079387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.079522] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.121025] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 in Status: SUCCESS [ 1033.121310] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a12f01d2-8146-4dc7-b376-a70f9bc9f697 deletion is rescheduled due to dependency. [ 1033.121483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a12f01d2-8146-4dc7-b376-a70f9bc9f697" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.480573] env[69274]: INFO networking_nsxv3.common.synchronization [req-7308e853-e1b1-4507-bf9d-b41c852c6bf3 req-4a21fccf-0fd8-41eb-8158-bf870b90fdbb service nova] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_rules [ 1033.480573] env[69274]: INFO networking_nsxv3.common.synchronization [req-7308e853-e1b1-4507-bf9d-b41c852c6bf3 req-4a21fccf-0fd8-41eb-8158-bf870b90fdbb service nova] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1033.480573] env[69274]: INFO networking_nsxv3.common.synchronization [req-7308e853-e1b1-4507-bf9d-b41c852c6bf3 req-4a21fccf-0fd8-41eb-8158-bf870b90fdbb service nova] Enqueued Resource ID: 08a0a431-85d4-4698-8d8e-c2d089c1f7f4 with Priority: HIGHEST for action port [ 1033.480573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_rules [ 1033.480573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1033.480573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a0a431-85d4-4698-8d8e-c2d089c1f7f4 with Priority: HIGHEST for action port [ 1033.480573] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.480573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.480948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.480948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.480948] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.483112] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.483231] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.483365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.483568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.484151] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.484263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.484330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.484494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.484581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.484681] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.486110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.486110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.486110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.486110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.486884] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a0a431-85d4-4698-8d8e-c2d089c1f7f4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.573241] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.582027] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.988797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.989035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.989172] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.991805] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08a0a431-85d4-4698-8d8e-c2d089c1f7f4 with status ACTIVE [ 1033.992159] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.992312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.992384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.992603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.992696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.992888] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.992998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.993119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.993366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.993453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.993659] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.993767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.993808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.993951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.994036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.994121] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08a0a431-85d4-4698-8d8e-c2d089c1f7f4 is going to be updated. [ 1034.019245] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.019496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.019596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.019822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.019973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.020199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08a0a431-85d4-4698-8d8e-c2d089c1f7f4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.076136] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.076341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.076389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.076598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.076694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.076800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1034.084975] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fda5f29a-8aee-4dfa-bf8c-4b53899b25f9: rpc.has_security_group_logging(os_id): False [ 1034.111079] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.111269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.111397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.111753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.111910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.112340] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.112531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.112649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.112944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.113119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.113338] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 is going to be created. [ 1034.134608] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.134793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.134851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.135109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.135295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.145074] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1034.230292] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.230292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.230292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.230292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.230292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.247529] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: IN_PROGRESS for 2s [ 1034.491158] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.994492] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.994492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.994883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.994883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.994883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.995037] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be created. [ 1035.027665] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.027665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.027665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.027984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.027984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.038519] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: UNINITIALIZED for 2s [ 1036.157675] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1036.161666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.260166] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: SUCCESS [ 1036.260343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.442381] env[69274]: INFO networking_nsxv3.common.synchronization [req-e486610f-047a-4758-b762-38f149e3b6e4 req-c0360b43-4c9b-4028-b227-379d4bfb32c5 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1036.443534] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1036.444051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.444287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.444464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.444782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.445025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.445189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.445294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.445512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.445649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.445914] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.907126] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.907126] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.907126] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.907746] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.907746] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.907902] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.907937] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.908586] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.908586] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.908718] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.908900] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.909410] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.909410] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.909410] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.909958] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.910192] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.927630] env[69274]: INFO networking_nsxv3.common.synchronization [req-9088428c-bcb1-412f-9a71-73e2fb91f3ca req-13b5e134-f132-4e9d-bc53-fa244131f658 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1036.928416] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1036.929459] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.929459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.929459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.929459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.929459] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.929459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.929941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.929983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.930122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.930500] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.932695] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.933236] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1036.933236] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.933437] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.933780] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-eba92ed4-9055-4ef4-b799-c136474d9c87 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.934035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.934206] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.934516] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.934689] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba92ed4-9055-4ef4-b799-c136474d9c87',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.953733] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.953733] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.953733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.953733] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1036.992698] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.994102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.994102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.994102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.994102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.008505] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1037.050582] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: SUCCESS [ 1037.050582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.050582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.050582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.050919] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.050919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.050919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.051119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.051201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.051287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.051370] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.438045] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.438045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.438045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.438045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.438620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.438620] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.438620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.438829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.438829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.438927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.438974] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 1037.440486] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.440588] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.440642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.440880] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.441044] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.441368] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.441539] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.441666] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.441890] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.442045] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.442343] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.442528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.442627] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.442852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.442993] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.443159] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: eba92ed4-9055-4ef4-b799-c136474d9c87 is going to be updated. [ 1037.465231] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.465492] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.465586] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.465870] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.466085] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.466314] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.478599] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.478842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.478915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.479254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.479481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.489020] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 1037.553815] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.554047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.554124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.554385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.556078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.556203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.556298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.556682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.556682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.556780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.556913] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.557057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.557124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.557287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.557506] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.557645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.557714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.557864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.557949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.558049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.558155] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.060532] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fe47e7d-d5da-4198-a8d5-ecc0c017948d: rpc.has_security_group_logging(os_id): False [ 1038.082102] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.082345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.082345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.082740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.082740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.082909] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.083594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.083594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.083594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.083594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.083594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.083594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.083594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.083884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.083884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.084073] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.084175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.084236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.084588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.084588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.084588] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be created. [ 1038.160665] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.161154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.161154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.161154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.161534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.182730] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: IN_PROGRESS for 2s [ 1038.253795] env[69274]: INFO networking_nsxv3.common.synchronization [req-d18d4b02-ee51-47cf-8346-e13cf0ae627c req-3b8142f6-5dd0-4384-9321-ee370968c93b service nova] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 1038.253795] env[69274]: INFO networking_nsxv3.common.synchronization [req-d18d4b02-ee51-47cf-8346-e13cf0ae627c req-3b8142f6-5dd0-4384-9321-ee370968c93b service nova] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 1038.253795] env[69274]: INFO networking_nsxv3.common.synchronization [req-d18d4b02-ee51-47cf-8346-e13cf0ae627c req-3b8142f6-5dd0-4384-9321-ee370968c93b service nova] Enqueued Resource ID: eba92ed4-9055-4ef4-b799-c136474d9c87 with Priority: HIGHEST for action port [ 1038.253795] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_rules [ 1038.253957] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 1038.254108] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba92ed4-9055-4ef4-b799-c136474d9c87 with Priority: HIGHEST for action port [ 1038.254617] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.254743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.254809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.255013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.255285] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.260029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.260029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.260029] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.260029] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba92ed4-9055-4ef4-b799-c136474d9c87 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.260029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.260029] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba92ed4-9055-4ef4-b799-c136474d9c87',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.761027] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.762286] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.762415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.762553] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eba92ed4-9055-4ef4-b799-c136474d9c87 with status ACTIVE [ 1038.762715] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.762825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.762906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.763150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.763265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.765020] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.765020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.765020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.765020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.765020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.765394] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.765394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.765500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.765661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.765787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.769335] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eba92ed4-9055-4ef4-b799-c136474d9c87 is going to be updated. [ 1038.794421] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.794887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.795021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.795259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.795421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.795614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba92ed4-9055-4ef4-b799-c136474d9c87" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.023190] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1039.023621] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1039.023621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.272750] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.501269] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 1039.501882] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 1039.502176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.775394] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.775726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.775726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.775847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.775941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.776093] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb is going to be updated. [ 1039.783093] env[69274]: INFO networking_nsxv3.common.synchronization [req-f9e6dde8-96fd-4525-9435-5e79120ec016 req-bc43cf36-7df8-4fca-a4f6-b157ae9d807d tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1039.783849] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1039.784208] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.784354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.784446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.784801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.784985] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.785086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.785152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.785329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.785497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.785532] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.807376] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.807601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.807646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.807939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.808204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.822735] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: IN_PROGRESS for 2s [ 1040.112262] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-959 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.112524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-959" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.112669] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-959" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.113023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-959" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.113473] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.113689] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.113826] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.114106] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.114309] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.114577] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.114709] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.114829] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.114945] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.115122] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.115258] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.115405] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.136803] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.136985] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1040.137089] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.137243] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-959" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.137746] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-001f5d5b-d421-41e1-8557-69e3b72851ff taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.137969] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.138134] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.138473] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.138618] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001f5d5b-d421-41e1-8557-69e3b72851ff',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.200566] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: SUCCESS [ 1040.200566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.288756] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.288756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.288892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.289105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.289208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.289441] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.289549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.289628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.289793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.289885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.290133] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 already deleted. [ 1040.290133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.640995] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.641906] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.641906] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.642516] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.642883] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.643049] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 001f5d5b-d421-41e1-8557-69e3b72851ff not found, creating... [ 1040.643477] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.643781] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.644083] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.644755] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.644821] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.645366] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.645611] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.645762] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.646037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.646194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.646359] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 001f5d5b-d421-41e1-8557-69e3b72851ff is going to be created. [ 1040.671749] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.671973] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.672123] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.672442] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.672696] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.672934] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.478512] env[69274]: INFO networking_nsxv3.common.synchronization [req-f9e6dde8-96fd-4525-9435-5e79120ec016 req-9a282900-4a55-44a8-ae80-e74005af71cb service nova] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_rules [ 1041.478512] env[69274]: INFO networking_nsxv3.common.synchronization [req-f9e6dde8-96fd-4525-9435-5e79120ec016 req-9a282900-4a55-44a8-ae80-e74005af71cb service nova] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1041.478816] env[69274]: INFO networking_nsxv3.common.synchronization [req-f9e6dde8-96fd-4525-9435-5e79120ec016 req-9a282900-4a55-44a8-ae80-e74005af71cb service nova] Enqueued Resource ID: 001f5d5b-d421-41e1-8557-69e3b72851ff with Priority: HIGHEST for action port [ 1041.479646] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_rules [ 1041.479646] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1041.479646] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001f5d5b-d421-41e1-8557-69e3b72851ff with Priority: HIGHEST for action port [ 1041.479861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.479954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.480666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.481304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.481304] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.482512] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.482512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.482512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.482512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.482689] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.482689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.482689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.482849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.482893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.482980] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.484878] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-001f5d5b-d421-41e1-8557-69e3b72851ff taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.484878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.484878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.484878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.484878] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001f5d5b-d421-41e1-8557-69e3b72851ff',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.843872] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: SUCCESS [ 1041.843872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.844106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.844761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.844761] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.844761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.844761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.844976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.844976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.845061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.845136] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.986754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.986907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.987163] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.988231] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 001f5d5b-d421-41e1-8557-69e3b72851ff with status ACTIVE [ 1041.988829] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.988829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.988829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.988829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.989352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.989352] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.989352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.989352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.989352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.989551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.989667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.996224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.996379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.996646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.996753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.996867] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 001f5d5b-d421-41e1-8557-69e3b72851ff is going to be updated. [ 1042.010365] env[69274]: INFO networking_nsxv3.common.synchronization [req-47172e8b-736c-4b9c-a564-968a4a69e56e req-7ebb3193-0004-40f1-81c3-7fd2830f7d3d tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1042.011075] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1042.011399] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.011529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.011591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.011794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.011943] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.012056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.012121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.012275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.012347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.012442] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.019889] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.020035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.020112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.020296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.020435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.020596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.347291] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.499055] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.514815] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.850030] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1c536af-bbdd-43d4-96ae-ba31d5403fdb: rpc.has_security_group_logging(os_id): False [ 1042.868722] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.868937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.868937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.869192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.869509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.869597] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.869660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.869694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.869850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.869928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.870142] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb is going to be updated. [ 1042.925487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.925487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.925487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.925487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.925487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.941448] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: IN_PROGRESS for 2s [ 1043.001329] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.001507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.001689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.001903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.002062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.002240] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be created. [ 1043.017878] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.066678] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.066865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.066942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.067182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.067358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.084326] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: UNINITIALIZED for 2s [ 1043.521598] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.521598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.522172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.523104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.523104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.523297] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1043.566555] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.566829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.566829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.567116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.567319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.582136] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1044.957403] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: SUCCESS [ 1044.957749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.097034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1045.097307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.097504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.097772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.097994] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.098144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.098216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.098410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.098504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.098615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.098713] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.595040] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1045.597911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.601202] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.602356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.602626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.603547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.604103] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.604748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.606037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.606037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.606037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.606037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.606037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.606037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.606037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.606535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.606535] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.606535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.606774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.606873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.606912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.606979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.607089] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.854743] env[69274]: INFO networking_nsxv3.common.synchronization [req-2ab305d8-6a1b-458a-94d5-cf87efe136d2 req-e50e0c86-66c1-4ac9-b882-3fe842507629 tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1045.855442] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1045.855823] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.855952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.856237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.856237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.856391] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.856511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.856591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.856740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.856852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.856935] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.110364] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8705637-f06c-4d6f-9572-5834d3c02c76: rpc.has_security_group_logging(os_id): False [ 1046.135279] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.135416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.135501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.137654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.137654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.137654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.137654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.138226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.138226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.138226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.138226] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be created. [ 1046.207261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.207261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.207261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.207512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.210677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.221408] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: IN_PROGRESS for 2s [ 1046.304451] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.304451] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.304451] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.305127] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.306696] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.307149] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.307452] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.307871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.313680] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.313680] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.313680] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.313680] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.313680] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.313680] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.313680] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.313680] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.335194] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.335194] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.335194] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.335194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-458" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.335194] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-682dc532-ee27-4f19-92ab-f45878d2f54a taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.335194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.335194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.336249] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.336624] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('682dc532-ee27-4f19-92ab-f45878d2f54a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.361359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.361359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.361359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.361359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.361359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.361359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.361359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.364021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.364021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.364021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.364021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 1046.436065] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.436065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.436065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.436065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.436452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.458244] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 1046.839522] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.839716] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.839829] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.840168] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.840323] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.840491] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 682dc532-ee27-4f19-92ab-f45878d2f54a not found, creating... [ 1046.840796] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.840977] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.841116] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.841407] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.841563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.841899] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.842088] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.842218] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.842473] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.842694] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.842768] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 682dc532-ee27-4f19-92ab-f45878d2f54a is going to be created. [ 1046.879942] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.880108] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.880186] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.880559] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.881179] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.881528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.719836] env[69274]: INFO networking_nsxv3.common.synchronization [req-2ab305d8-6a1b-458a-94d5-cf87efe136d2 req-e0e620f6-a86c-4775-a867-c88c5e2702e6 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 1047.720124] env[69274]: INFO networking_nsxv3.common.synchronization [req-2ab305d8-6a1b-458a-94d5-cf87efe136d2 req-e0e620f6-a86c-4775-a867-c88c5e2702e6 service nova] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1047.720254] env[69274]: INFO networking_nsxv3.common.synchronization [req-2ab305d8-6a1b-458a-94d5-cf87efe136d2 req-e0e620f6-a86c-4775-a867-c88c5e2702e6 service nova] Enqueued Resource ID: 682dc532-ee27-4f19-92ab-f45878d2f54a with Priority: HIGHEST for action port [ 1047.720815] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_rules [ 1047.721159] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1047.721328] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 682dc532-ee27-4f19-92ab-f45878d2f54a with Priority: HIGHEST for action port [ 1047.721729] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.721981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.722041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.722319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.722443] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.723440] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.723598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.723876] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-682dc532-ee27-4f19-92ab-f45878d2f54a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.723989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.724433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.724681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.724801] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('682dc532-ee27-4f19-92ab-f45878d2f54a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.227308] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.227507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.227617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 682dc532-ee27-4f19-92ab-f45878d2f54a with status ACTIVE [ 1048.227818] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.227899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.227965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.228205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.228297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.228476] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.228571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.228630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.228779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.228853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.229046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.229144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.229190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.229330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.229420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.229505] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 682dc532-ee27-4f19-92ab-f45878d2f54a is going to be updated. [ 1048.236554] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1048.236858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.274242] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.274392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.274458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.274741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.274922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.275090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-682dc532-ee27-4f19-92ab-f45878d2f54a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.367263] env[69274]: INFO networking_nsxv3.common.synchronization [req-0d9e5e52-de73-4e0c-89a8-105dd238429f req-66b19ed2-a7ff-475c-bc0f-7f92a51f5cd3 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_members [ 1048.367263] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGHEST for action security_group_members [ 1048.369049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.369211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.369295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.369528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.369734] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.370072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.370165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.370351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.370444] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.370573] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.470253] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 1048.470253] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 1048.470253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.470253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.470253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.470253] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.470253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.470253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.470253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.470253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.470253] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.872983] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.873347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.873347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.873541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.896915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.896915] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.896915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.897058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.897216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.897300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.897870] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 is going to be updated. [ 1048.930130] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.930632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.930734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.930989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.931211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.942251] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 in Status: IN_PROGRESS for 2s [ 1048.976623] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.478699] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.981550] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.981941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.981994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.982238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.982338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.982447] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 1050.016906] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.017141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.017141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.017302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.017457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.029145] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 1050.952105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 in Status: SUCCESS [ 1050.952346] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 deletion is rescheduled due to dependency. [ 1050.952436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.040170] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 1052.041012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.041012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.041012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.041012] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.041200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.041200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.041334] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.041410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.041493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.041645] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.548593] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.548771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.548842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.549070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.549258] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.549380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.549462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.549655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.549800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.549916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.550098] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.550230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.550278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.550429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.550571] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.550664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.550724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.550859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.550936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.551123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.551262] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.704169] env[69274]: INFO networking_nsxv3.common.synchronization [req-b15ea542-a4f5-48c6-aa9a-478d0ca84a6d req-6c0faaae-2a38-490f-8011-4c1a24fc9778 tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1052.704720] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1052.705204] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.705347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.705416] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.705612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.705883] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.706009] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.706083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.706268] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.706359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.706424] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.054273] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c216e0c6-b262-4569-8d09-772eeaa39501: rpc.has_security_group_logging(os_id): False [ 1053.077061] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.077277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.078042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.078042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.078042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.078042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.078344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.078344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.078344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.078452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.078618] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.078764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.078800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.078964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.079069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.079240] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.079330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.079390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.079594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.079740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.079848] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 1053.166454] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.166752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.166876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.167200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.167452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.183525] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 1053.208205] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.208406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.208482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.209099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.209099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.209267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.209369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.209443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.209617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.209717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.209786] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1053.257049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.257272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.257272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.257516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.257695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.279754] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1054.151245] env[69274]: INFO networking_nsxv3.common.synchronization [req-3d84a6c3-387f-4f9a-98b0-bd9e90fbb9a2 req-aecbe859-3e5a-489c-9481-2a605ff36e61 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1054.151825] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1054.152193] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.152570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.152644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.152862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.153021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.153149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.153226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.153379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.153537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.153718] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.621036] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.621234] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.621469] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.621724] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.622382] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.622762] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.623015] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.623357] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.623786] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.624111] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.624299] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.624502] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.624687] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.624945] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.625087] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.625299] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.653254] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.653494] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.653670] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.653856] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.654222] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-bc738db3-de41-490e-a520-08e2e7f1056c taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.654408] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.654580] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.654937] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.655508] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc738db3-de41-490e-a520-08e2e7f1056c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.656575] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.159725] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.160079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.160079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.160266] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.160432] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.160619] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port bc738db3-de41-490e-a520-08e2e7f1056c not found, creating... [ 1055.160911] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.161104] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.161283] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.161767] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.161923] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.162409] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.162409] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.162646] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.162697] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.162844] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.162988] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: bc738db3-de41-490e-a520-08e2e7f1056c is going to be created. [ 1055.164176] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.186749] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.186992] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.187312] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.187676] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.187935] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.188911] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.196963] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 1055.196963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.290088] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1055.290088] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 deletion is rescheduled due to dependency. [ 1055.290088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.667644] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.667903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.667991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.668327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.668403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.668458] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1055.703277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.703277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.703277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.703277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.703277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.712989] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1055.915120] env[69274]: INFO networking_nsxv3.common.synchronization [req-3d84a6c3-387f-4f9a-98b0-bd9e90fbb9a2 req-0155e3fa-6412-4901-be25-6127ba2a097a service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 1055.915290] env[69274]: INFO networking_nsxv3.common.synchronization [req-3d84a6c3-387f-4f9a-98b0-bd9e90fbb9a2 req-0155e3fa-6412-4901-be25-6127ba2a097a service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1055.915440] env[69274]: INFO networking_nsxv3.common.synchronization [req-3d84a6c3-387f-4f9a-98b0-bd9e90fbb9a2 req-0155e3fa-6412-4901-be25-6127ba2a097a service nova] Enqueued Resource ID: bc738db3-de41-490e-a520-08e2e7f1056c with Priority: HIGHEST for action port [ 1055.915697] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 1055.915841] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1055.915937] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc738db3-de41-490e-a520-08e2e7f1056c with Priority: HIGHEST for action port [ 1055.916537] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.916697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.916737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.916941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.917189] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.918754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.919025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.919227] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc738db3-de41-490e-a520-08e2e7f1056c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.919385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.919495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.919728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.919856] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc738db3-de41-490e-a520-08e2e7f1056c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.422182] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.422627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.422627] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc738db3-de41-490e-a520-08e2e7f1056c with status ACTIVE [ 1056.422718] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.422789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.422820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.423033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.423127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.423310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.423418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.423506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.423671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.423754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.423941] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.424055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.424121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.424262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.424356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.424471] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc738db3-de41-490e-a520-08e2e7f1056c is going to be updated. [ 1056.480360] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.480579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.480790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.481064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.481238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.481498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc738db3-de41-490e-a520-08e2e7f1056c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.723904] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1057.724283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.724351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.724668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.724864] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.724991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.725064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.725220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.725303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.725401] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.152026] env[69274]: INFO networking_nsxv3.common.synchronization [None req-624d94da-4e4e-4f56-9b2f-64503b9e54b9 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_rules [ 1058.152572] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_rules [ 1058.152890] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.153335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.153497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.153831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.153932] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.228469] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.234409] env[69274]: INFO networking_nsxv3.common.synchronization [None req-59a9366f-e4e3-481a-a3ca-1d66e77f4b1e tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_rules [ 1058.234945] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_rules [ 1058.235306] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.235406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.675961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.676153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.676217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.677262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.677262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.677262] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 already deleted. [ 1058.677262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.677262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.677262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.677262] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.729758] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.200064] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.200164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.200227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.201069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.201069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.201069] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 already deleted. [ 1059.201069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.235128] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.235128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.235128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.235128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.235128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.235128] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1059.270723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.270723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.270723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.270723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.270723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.279386] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1059.579403] env[69274]: INFO networking_nsxv3.common.synchronization [req-2175aba2-d281-42c1-bd44-7bd4c1057e50 req-dc1a97ef-06fd-4538-a25e-1667a0539a1b tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1059.579403] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1059.579403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.579403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.579403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.579403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.579403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.580351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.580564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.581502] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.581649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.581792] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.088746] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.089798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.089798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.089798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.089798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.089798] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.089798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.090055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.090332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.090332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.090332] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1060.122129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.122129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.122129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.122129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.122129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.136297] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1060.165847] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.166079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.166231] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.166537] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.167485] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.167485] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.167485] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.167713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.167747] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.167967] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.168112] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.168243] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.168367] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.168496] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.169703] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.169703] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.190983] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.190983] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.190983] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.190983] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.191309] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-c47dea8d-9c28-45f6-bb59-580a23a9311a taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.191423] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.191740] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.192379] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.192583] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c47dea8d-9c28-45f6-bb59-580a23a9311a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.695616] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.695840] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.695974] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.696295] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.696468] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.696641] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port c47dea8d-9c28-45f6-bb59-580a23a9311a not found, creating... [ 1060.696907] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.697092] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.697220] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.697456] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.697660] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.698015] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.698198] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.698327] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.698548] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.698692] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.698838] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: c47dea8d-9c28-45f6-bb59-580a23a9311a is going to be created. [ 1060.721332] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.721612] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.721747] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.722030] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.722263] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.722498] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.884702] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2389427-3e1f-43bf-921e-981651ab5a3a req-dcfb91d4-c978-4484-8e9a-f71cd4244f74 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1060.884927] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2389427-3e1f-43bf-921e-981651ab5a3a req-dcfb91d4-c978-4484-8e9a-f71cd4244f74 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_members [ 1060.885527] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1060.885678] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_members [ 1060.886051] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.886183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.886233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.886425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.886581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.886684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.886754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.886891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.886983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.887088] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.888389] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-baa47294-a4e8-49b6-b054-0eef8f422f81 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.888512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.888587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.888800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.889058] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.889058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.889191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.889278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.889347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.889454] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.932947] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2389427-3e1f-43bf-921e-981651ab5a3a req-dcfb91d4-c978-4484-8e9a-f71cd4244f74 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_rules [ 1060.933237] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2389427-3e1f-43bf-921e-981651ab5a3a req-dcfb91d4-c978-4484-8e9a-f71cd4244f74 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_members [ 1060.933591] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2389427-3e1f-43bf-921e-981651ab5a3a req-dcfb91d4-c978-4484-8e9a-f71cd4244f74 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_rules [ 1060.933685] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2389427-3e1f-43bf-921e-981651ab5a3a req-dcfb91d4-c978-4484-8e9a-f71cd4244f74 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1060.933829] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2389427-3e1f-43bf-921e-981651ab5a3a req-dcfb91d4-c978-4484-8e9a-f71cd4244f74 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: 001f5d5b-d421-41e1-8557-69e3b72851ff with Priority: HIGHEST for action port [ 1060.934524] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_rules [ 1060.934746] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_rules [ 1060.934901] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001f5d5b-d421-41e1-8557-69e3b72851ff with Priority: HIGHEST for action port [ 1060.935034] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_members [ 1060.935168] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1060.935545] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-baa47294-a4e8-49b6-b054-0eef8f422f81 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.935644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.935685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.935998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.936093] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.937413] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.937608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.937694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.937961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.938078] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.939041] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-001f5d5b-d421-41e1-8557-69e3b72851ff taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.939142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.939251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.939551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.939614] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001f5d5b-d421-41e1-8557-69e3b72851ff',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.940453] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-baa47294-a4e8-49b6-b054-0eef8f422f81 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.940546] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.940991] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.941089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.289619] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1061.289960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.290407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.290737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.290919] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.291399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.291399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.291399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.291532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.291783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.291899] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.391506] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.392418] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.440013] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3b4a3f9-daf7-4140-86ac-46985d496217 req-26d9ad60-0d77-441e-b6d5-18a3091fa89b tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1061.440230] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3b4a3f9-daf7-4140-86ac-46985d496217 req-26d9ad60-0d77-441e-b6d5-18a3091fa89b tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_members [ 1061.440729] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1061.440868] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baa47294-a4e8-49b6-b054-0eef8f422f81 with Priority: HIGHEST for action security_group_members [ 1061.441170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.441277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.442161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-baa47294-a4e8-49b6-b054-0eef8f422f81 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.442161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.442161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-baa47294-a4e8-49b6-b054-0eef8f422f81 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.442161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.442390] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.442390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.442558] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 001f5d5b-d421-41e1-8557-69e3b72851ff with status ACTIVE [ 1061.442679] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.442759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.442825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.443035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.443130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.443297] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.443396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.443513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.443710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.443794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.443998] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.444113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.444175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.444322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.444399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.444507] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 001f5d5b-d421-41e1-8557-69e3b72851ff is going to be updated. [ 1061.466127] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.466328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.466399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.466583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.466755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.466931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.519141] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3b4a3f9-daf7-4140-86ac-46985d496217 req-26d9ad60-0d77-441e-b6d5-18a3091fa89b tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_rules [ 1061.519343] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3b4a3f9-daf7-4140-86ac-46985d496217 req-26d9ad60-0d77-441e-b6d5-18a3091fa89b tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1061.519490] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3b4a3f9-daf7-4140-86ac-46985d496217 req-26d9ad60-0d77-441e-b6d5-18a3091fa89b tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: 001f5d5b-d421-41e1-8557-69e3b72851ff with Priority: HIGHEST for action port [ 1061.519996] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_rules [ 1061.520152] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1061.520249] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001f5d5b-d421-41e1-8557-69e3b72851ff with Priority: HIGHEST for action port [ 1061.520518] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.520619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.520813] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.520896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.521595] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-001f5d5b-d421-41e1-8557-69e3b72851ff taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.521739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.521775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.522089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.522175] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001f5d5b-d421-41e1-8557-69e3b72851ff',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.596672] env[69274]: INFO networking_nsxv3.common.synchronization [req-2175aba2-d281-42c1-bd44-7bd4c1057e50 req-d773ef51-9eb3-4f84-a143-9de984d6ecc7 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1061.596996] env[69274]: INFO networking_nsxv3.common.synchronization [req-2175aba2-d281-42c1-bd44-7bd4c1057e50 req-d773ef51-9eb3-4f84-a143-9de984d6ecc7 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1061.597247] env[69274]: INFO networking_nsxv3.common.synchronization [req-2175aba2-d281-42c1-bd44-7bd4c1057e50 req-d773ef51-9eb3-4f84-a143-9de984d6ecc7 service nova] Enqueued Resource ID: c47dea8d-9c28-45f6-bb59-580a23a9311a with Priority: HIGHEST for action port [ 1061.597939] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1061.598174] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1061.598339] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c47dea8d-9c28-45f6-bb59-580a23a9311a with Priority: HIGHEST for action port [ 1061.598717] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.598885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.598978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.599366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.599427] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.600567] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.600732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.601133] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c47dea8d-9c28-45f6-bb59-580a23a9311a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.601221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.601265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.601536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.601604] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c47dea8d-9c28-45f6-bb59-580a23a9311a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.794456] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.794712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.794798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.795110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.795359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.795520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.795631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.795850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.795989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.796165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.796370] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.796521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.796672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.796826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.797113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.797233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.797310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.797457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.797537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.797623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.797716] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.893768] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.894792] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.028889] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 001f5d5b-d421-41e1-8557-69e3b72851ff with status ACTIVE [ 1062.028889] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.028889] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.028889] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.028889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.028889] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 001f5d5b-d421-41e1-8557-69e3b72851ff is going to be updated. [ 1062.052677] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.052845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.053223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.053223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.053379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.053441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001f5d5b-d421-41e1-8557-69e3b72851ff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.104152] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.104767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.104767] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c47dea8d-9c28-45f6-bb59-580a23a9311a with status ACTIVE [ 1062.104767] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.104986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.104986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.105137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.105226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.105397] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.105482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.105566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.105697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.105941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.106195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.106195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.106195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.106344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.106418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.106860] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c47dea8d-9c28-45f6-bb59-580a23a9311a is going to be updated. [ 1062.130176] env[69274]: INFO networking_nsxv3.common.synchronization [req-d39a3c57-ec6c-4ce9-b268-fd687534030d req-eb48ff3c-19dd-47f8-a633-9835407b8cd5 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1062.131326] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.131460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.131525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.131727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.131864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.132189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c47dea8d-9c28-45f6-bb59-580a23a9311a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.132702] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1062.133019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.133131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.133201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.133376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.133581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.133678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.133741] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.133888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.133970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.134074] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.156920] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1062.157131] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 deletion is rescheduled due to dependency. [ 1062.157249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.157406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.157623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.157826] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.158026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.158026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.158167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.158250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.158348] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.301067] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 1062.322653] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.322653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.322653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.322653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.322653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.323044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.323044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.323044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.323044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.323267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.323267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.323385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.323385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.323570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.323651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.323844] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.323933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.323990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.324149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.324224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.324308] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1062.397122] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.397332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.397426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.397679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.397778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.397878] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be updated. [ 1062.399308] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.400521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.400521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.400521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.400521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.400521] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baa47294-a4e8-49b6-b054-0eef8f422f81 is going to be created. [ 1062.403030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.403160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.403238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.403438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.404662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.427709] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1062.436362] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.436362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.436362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.436362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.437848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.440766] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.440893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.440963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.441190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.441316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.445706] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.446018] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.446184] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.446450] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.446726] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.446896] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.447201] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.447464] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.447623] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.447911] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.447964] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.448099] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.448217] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.448338] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1062.448454] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.448599] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.455510] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: IN_PROGRESS for 2s [ 1062.456742] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baa47294-a4e8-49b6-b054-0eef8f422f81 in Status: UNINITIALIZED for 2s [ 1062.485636] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.485636] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1062.485838] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.486150] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.486493] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-a1f0348f-778b-4efc-a97f-202f086d1d1d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.486724] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.486865] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.487222] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.487376] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1f0348f-778b-4efc-a97f-202f086d1d1d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.639032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.639032] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.639032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.639032] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1062.661239] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.672134] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.672134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.672134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.672134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.672134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.682756] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1062.990735] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.990995] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.991152] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.991530] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.991663] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.991831] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port a1f0348f-778b-4efc-a97f-202f086d1d1d not found, creating... [ 1062.992243] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.992375] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.992430] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.992648] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.992798] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.993114] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.993281] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.993407] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.993716] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.993870] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.995398] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: a1f0348f-778b-4efc-a97f-202f086d1d1d is going to be created. [ 1063.019198] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.019497] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.019619] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.020026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.020361] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.020657] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.163668] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.669131] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.669131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.669131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.669131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.669131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.669131] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1063.699578] env[69274]: INFO networking_nsxv3.common.synchronization [req-d39a3c57-ec6c-4ce9-b268-fd687534030d req-3044c46e-16a7-43df-8fe1-971d7855c658 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1063.699578] env[69274]: INFO networking_nsxv3.common.synchronization [req-d39a3c57-ec6c-4ce9-b268-fd687534030d req-3044c46e-16a7-43df-8fe1-971d7855c658 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1063.699578] env[69274]: INFO networking_nsxv3.common.synchronization [req-d39a3c57-ec6c-4ce9-b268-fd687534030d req-3044c46e-16a7-43df-8fe1-971d7855c658 service nova] Enqueued Resource ID: a1f0348f-778b-4efc-a97f-202f086d1d1d with Priority: HIGHEST for action port [ 1063.700181] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1063.700473] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1063.700717] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f0348f-778b-4efc-a97f-202f086d1d1d with Priority: HIGHEST for action port [ 1063.702102] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.702499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.702728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.703123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.703452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.704961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.705330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.705534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.705906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.706135] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.707261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.707759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.707855] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1f0348f-778b-4efc-a97f-202f086d1d1d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.710421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.710540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.710789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.710911] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1f0348f-778b-4efc-a97f-202f086d1d1d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.721425] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1064.212915] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1f0348f-778b-4efc-a97f-202f086d1d1d with status ACTIVE [ 1064.213230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.213448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.213620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.214078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.214161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.214360] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.214446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.214533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.214692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.214813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.215435] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.215435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.215435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.215435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.215435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.215743] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1f0348f-778b-4efc-a97f-202f086d1d1d is going to be updated. [ 1064.216628] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.216737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.261785] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.261998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.262150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.262390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.262564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.262791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1f0348f-778b-4efc-a97f-202f086d1d1d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.446972] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1064.447737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.471345] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1064.471345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.471345] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: baa47294-a4e8-49b6-b054-0eef8f422f81 in Status: SUCCESS [ 1064.471345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.471345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.471345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.471345] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.471345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.471345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.472589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.472862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.473148] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.474612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.476054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.476054] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.476054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.476054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.476054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.476462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.476694] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.619353] env[69274]: INFO networking_nsxv3.common.synchronization [req-25073e9f-75d9-4143-a5d5-ba38b31c3c17 req-28e9c969-015b-4188-8cdd-2d46e9794e01 tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1064.619685] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1064.620472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.620667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.620922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.625305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.627983] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.628220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.628298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.628524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.628619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.628725] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.696829] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1064.696829] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1064.696829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.698864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.699260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.699667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.699929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.700163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.700423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.700987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.701307] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.982028] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.982028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.982028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.982028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.986398] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baa47294-a4e8-49b6-b054-0eef8f422f81 is going to be deleted. [ 1065.028190] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.028190] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.028190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.028190] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.092182] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-493 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.092182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.092182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.092182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.092363] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.092533] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.092655] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.093216] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.093216] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.094038] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.094038] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.094038] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.094038] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.094038] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.094552] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.094552] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.108459] env[69274]: INFO networking_nsxv3.common.synchronization [req-abbd6871-32d7-4f7d-9ce2-600cf75d2ee8 req-e1dd5f94-9b43-4774-a4c8-fe36d37a8d2f tempest-ServerDiskConfigTestJSON-1441424934 tempest-ServerDiskConfigTestJSON-1441424934-project-member] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1065.109163] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGHEST for action security_group_members [ 1065.109301] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.109731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.109805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.110023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.110185] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.110289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.110355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.110508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.110599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.110690] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.116040] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.116137] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.116256] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.116753] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-493" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.117120] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-8d67ac2a-9efa-449c-8a79-352823b70ed3 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.118182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.118571] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.118661] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.118799] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d67ac2a-9efa-449c-8a79-352823b70ed3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.130477] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.130892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.130892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.130892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.131014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.131171] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.132154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.132154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.132154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.132154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.132154] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1065.160048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.160175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.160175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.160351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.160499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.169930] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1065.204750] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.488271] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.532095] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.532095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.532095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.532638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.532638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.532638] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.532638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.532638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.532783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.532994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.533123] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baa47294-a4e8-49b6-b054-0eef8f422f81 already deleted. [ 1065.533663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.534389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.534659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.534817] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.534934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.535044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.535219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.535354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.535481] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.613348] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.613348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.613348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.613752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.614106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.614106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.614106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.614283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.614311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.614377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.614462] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be updated. [ 1065.621728] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.621728] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.621728] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.621728] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.622396] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.622396] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 8d67ac2a-9efa-449c-8a79-352823b70ed3 not found, creating... [ 1065.622676] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.622910] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.623128] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.623541] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.623898] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.624190] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.624392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.624572] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.624929] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.625109] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.625357] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 8d67ac2a-9efa-449c-8a79-352823b70ed3 is going to be created. [ 1065.707853] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.736921] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1065.737175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.737681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.737908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.738115] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.738746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.738746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.738746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.738746] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.738925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.738925] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.745495] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.745652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.745730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.745940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.746099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.747983] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.748997] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.749192] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.749508] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.749767] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.750055] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.759526] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: IN_PROGRESS for 2s [ 1065.992858] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.993107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.993190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.993374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.993474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.993660] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be updated. [ 1066.038411] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.038655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.038766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.039099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.039244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.039554] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.039794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.039794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.040017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.040140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.040261] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: baa47294-a4e8-49b6-b054-0eef8f422f81 already deleted. [ 1066.040377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.040508] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.043639] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.043938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.043938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.044150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.044332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.058304] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: IN_PROGRESS for 2s [ 1066.211171] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.211347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.211414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.211649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.211743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.211847] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1066.241147] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.241361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.241532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.241640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.241797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.241896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.241958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.242124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.242215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.242305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.242455] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.242551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.242612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.242758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.242962] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.243104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.243197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.243404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.243495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.243606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.243725] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.255992] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.256199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.256199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.256414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.256562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.267288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1066.346409] env[69274]: INFO networking_nsxv3.common.synchronization [req-25073e9f-75d9-4143-a5d5-ba38b31c3c17 req-2e5c5694-58e4-41ac-8fd1-7e77a0c76397 service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 1066.346600] env[69274]: INFO networking_nsxv3.common.synchronization [req-25073e9f-75d9-4143-a5d5-ba38b31c3c17 req-2e5c5694-58e4-41ac-8fd1-7e77a0c76397 service nova] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1066.346751] env[69274]: INFO networking_nsxv3.common.synchronization [req-25073e9f-75d9-4143-a5d5-ba38b31c3c17 req-2e5c5694-58e4-41ac-8fd1-7e77a0c76397 service nova] Enqueued Resource ID: 8d67ac2a-9efa-449c-8a79-352823b70ed3 with Priority: HIGHEST for action port [ 1066.347299] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_rules [ 1066.347455] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1066.347573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d67ac2a-9efa-449c-8a79-352823b70ed3 with Priority: HIGHEST for action port [ 1066.347871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.348009] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.348069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.348270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.348353] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.349214] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.349314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.349533] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d67ac2a-9efa-449c-8a79-352823b70ed3 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.349643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.349709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.349891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.349966] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d67ac2a-9efa-449c-8a79-352823b70ed3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.547322] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('baa47294-a4e8-49b6-b054-0eef8f422f81',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.745912] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb1c245e-fab2-4558-9acb-1f5c9442e963: rpc.has_security_group_logging(os_id): False [ 1066.763688] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.763688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.763688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.763951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.763951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.764217] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.764330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.764384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.764539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.764649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.764850] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.764973] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.765047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.765224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.765306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.765513] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.765638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.765708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.765875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.765963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.766074] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1066.839299] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.839447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.839649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.840200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.840387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.851723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.851870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.854324] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d67ac2a-9efa-449c-8a79-352823b70ed3 with status ACTIVE [ 1066.854546] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.854686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.854748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.855050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.855199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.855379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.855545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.855619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.856376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.856488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.856705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.857299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.857299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.857299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.857299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.857299] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d67ac2a-9efa-449c-8a79-352823b70ed3 is going to be updated. [ 1066.859843] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1066.882021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.882021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.882021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.882253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.882253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.882406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d67ac2a-9efa-449c-8a79-352823b70ed3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.049683] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for baa47294-a4e8-49b6-b054-0eef8f422f81: rpc.has_security_group_logging(os_id): False [ 1067.076072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.076072] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.076072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.076072] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baa47294-a4e8-49b6-b054-0eef8f422f81 is going to be created. [ 1067.096187] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/baa47294-a4e8-49b6-b054-0eef8f422f81], does not exist path=[/infra/domains/default/groups/baa47294-a4e8-49b6-b054-0eef8f422f81]."\n}' [ 1067.096554] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baa47294-a4e8-49b6-b054-0eef8f422f81 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/baa47294-a4e8-49b6-b054-0eef8f422f81 [ 1067.096554] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1067.155540] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.155693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.155775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.155967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.157565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.157937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.158039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.158039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.158208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.158301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.158481] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.158577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.158640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.158781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.158866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.158950] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: baa47294-a4e8-49b6-b054-0eef8f422f81 is going to be created. [ 1067.173895] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.174048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.174048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.174187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.174295] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.177840] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/baa47294-a4e8-49b6-b054-0eef8f422f81], does not exist path=[/infra/domains/default/groups/baa47294-a4e8-49b6-b054-0eef8f422f81]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/baa47294-a4e8-49b6-b054-0eef8f422f81 [ 1067.178036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-baa47294-a4e8-49b6-b054-0eef8f422f81" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.178256] env[69274]: Traceback (most recent call last): [ 1067.178292] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1067.178292] env[69274]: return func(*args, **kwargs) [ 1067.178292] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1067.178292] env[69274]: res.raise_for_status() [ 1067.178292] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1067.178292] env[69274]: raise HTTPError(http_error_msg, response=self) [ 1067.178292] env[69274]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/baa47294-a4e8-49b6-b054-0eef8f422f81 [ 1067.178292] env[69274]: During handling of the above exception, another exception occurred: [ 1067.178292] env[69274]: Traceback (most recent call last): [ 1067.178526] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1067.178526] env[69274]: listener.cb(fileno) [ 1067.178526] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1067.178526] env[69274]: result = function(*args, **kwargs) [ 1067.178526] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1067.178526] env[69274]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1067.178526] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1067.178526] env[69274]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1067.178526] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1067.178526] env[69274]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1067.178526] env[69274]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1067.178526] env[69274]: res.raise_for_status() [ 1067.178526] env[69274]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1067.178526] env[69274]: raise HTTPError(http_error_msg, response=self) [ 1067.178526] env[69274]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/baa47294-a4e8-49b6-b054-0eef8f422f81 [ 1067.178526] env[69274]: Removing descriptor: 5 [ 1067.179113] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1067.179186] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 deletion is rescheduled due to dependency. [ 1067.179286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.179428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.179904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.179904] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.179904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.180121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.180222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.180304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.180398] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.543470] env[69274]: INFO networking_nsxv3.common.synchronization [None req-cadaaf78-2220-495e-a7c8-6ebf7e9043ea tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1067.544061] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1067.544379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.544500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.544568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.544765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.544912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.545118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.545204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.545359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.545447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.545541] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.676396] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.681974] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.768997] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c216e0c6-b262-4569-8d09-772eeaa39501 in Status: SUCCESS [ 1067.769363] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 deletion is rescheduled due to dependency. [ 1067.769363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.047429] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.073481] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1068.073821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.074016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.074245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.074438] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.074562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.074675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.074809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.074948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.074987] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.180057] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.184373] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.279126] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1068.279403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.279584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.279837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.280177] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.280330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.280384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.280594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.280712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.280802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.280912] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.549345] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.578081] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.685023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1068.685023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1068.687275] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.687484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.687577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.687805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.687941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.688113] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1068.716015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.716015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.716015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.716403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.716403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.726043] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1068.783382] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.783751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.783751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.783926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.784062] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.784214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.784214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.784356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.784445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.784535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.784705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.784802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.784861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.785010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.785240] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.785240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.785562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.785562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.785562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.785562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.785874] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.874958] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1068.875206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.052083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.052314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.052413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.052556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.052634] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.052733] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1069.078857] env[69274]: INFO networking_nsxv3.common.synchronization [req-99d36bf1-0e11-4826-a1f7-5352e4880808 req-ed013006-18cf-4771-bd44-d2161b0dda62 tempest-ServerRescueTestJSON-2125380106 tempest-ServerRescueTestJSON-2125380106-project-member] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1069.079499] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.083101] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1069.083629] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.083784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.083853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.084050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.084211] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.084313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.084386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.084562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.084999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.084999] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.087221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.087351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.087407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.087571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.087769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.100138] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1069.288820] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf62572c-aed8-4405-8e2e-513d1f9f3976: rpc.has_security_group_logging(os_id): False [ 1069.311643] env[69274]: INFO networking_nsxv3.common.synchronization [req-a1a53e87-ec13-4b28-ba35-31eaab30c945 req-a2baf2eb-d348-46c4-91c7-c4a81dbe84e3 tempest-ServerRescueTestJSONUnderV235-990752680 tempest-ServerRescueTestJSONUnderV235-990752680-project-member] Enqueued Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1069.312410] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8705637-f06c-4d6f-9572-5834d3c02c76 with Priority: HIGHEST for action security_group_members [ 1069.312801] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.312888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.314419] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.314718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.314859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.315172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.341108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.341408] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.341524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.341591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.341805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.341891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.342099] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.342196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.342261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.342408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.342483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.342676] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.342774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.342836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.342976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.344245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.344245] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1069.405190] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.405461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.405461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.405654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.405808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.423391] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1069.584281] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.584467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.584467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.585438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.585622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.585793] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be updated. [ 1069.587479] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.612976] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.613215] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.613357] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.613745] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.614034] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.614206] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.614337] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.614578] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.614830] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.615149] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.615337] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.615548] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.615752] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.616033] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.616215] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.616401] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.647350] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.647530] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.647675] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.647863] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-829" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.648215] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.648400] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.648526] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.648871] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.649035] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3bdedb9-1032-4370-9f5c-1696fd2dc2d6',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.650956] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.651096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.651166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.651352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.651494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.665753] env[69274]: INFO networking_nsxv3.common.synchronization [req-a248118d-5c9e-47d2-9f12-c0c00431680a req-a1dfaa46-58e9-40ce-ba6e-60dfb442432d tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1069.667196] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: IN_PROGRESS for 2s [ 1069.667971] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1069.668510] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.668640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.668713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.668906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.669080] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.669183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.669250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.669399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.669484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.669581] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.671378] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.671641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.671719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.671931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.684306] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1069.685266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.686696] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1069.690148] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.691977] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.692242] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.692752] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.692752] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.692995] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.692995] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.693102] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.694029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.694029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.694029] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.694029] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.694029] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.694237] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.694237] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.694303] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.695137] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.737089] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.737899] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.738132] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.738339] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.738843] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-c8575846-9cad-4667-a9f2-fddffe5b7fe7 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.739119] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.739261] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.739647] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.740806] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8575846-9cad-4667-a9f2-fddffe5b7fe7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.752780] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.752955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.753044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.753279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.764500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.765317] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1069.765409] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1069.765506] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1069.816797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.817272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.817272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.817272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.818366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.818593] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1069.899492] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.899742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.899835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.900081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.900426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.900711] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1069.989330] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.989547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.989611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.989865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.990192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.990547] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1069.990658] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'118f1c99-f1b0-40d7-b8be-502ee4dd3ac7', '093f0a21-7741-4a8f-8410-d5b196f0f7d7', 'fd7d0f6f-e583-4619-be1a-10cbd86bd911', '99b68d96-5b1d-4bdb-9748-7b151abff183', '7fa3cd7b-c562-43e1-96fe-99002d55eac1', '75b08f22-c6d6-4014-88bf-a9fe927483cc', 'f601a42d-d49f-43f8-8ef0-10af2ee0fa8d', '4d18e8e1-0498-42f1-a212-e38138ab2e9a', '006dff36-9ba4-4e78-adb7-43e0f38d6a3e', 'dda0f1e4-d4a5-4ea2-b797-7489d5e4067d', 'fda5f29a-8aee-4dfa-bf8c-4b53899b25f9', 'b8176f39-b0b7-4ab1-9307-d82b36d10bfe', 'd1ed1d16-c48a-4859-8659-45390ac1d1a8', '2c76c584-6c00-46aa-955a-014f7c87551a', 'ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a', 'c1c536af-bbdd-43d4-96ae-ba31d5403fdb', '2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f', 'aa1a9a97-83f8-48ba-9ef7-ddec60300629', 'cebac9fe-4ea0-40a1-a949-d690687274d0', 'c216e0c6-b262-4569-8d09-772eeaa39501', 'df948508-d1d6-4368-979c-297ed94dda9d', '425a6912-a0c6-4fca-8187-80a58f8e7880', 'a499f7e4-147f-443a-94fe-27f18e7a8418', '833fffe2-1aa6-4f10-9ea0-4e315ed92177', '15291f2b-281c-4bf0-a609-bcb369c82f51', '644d845b-e0e5-49b2-b970-585c199651e8', 'c6965fde-94e0-450b-9c8a-b2de7355cdc4', 'da1c3475-4204-4218-9478-83b2e1605cd7', '8836cb7d-c446-445d-9406-a28a71bb6de4', '263ec48b-f6d4-4404-82b0-3777225d4fe1', 'c5cb0145-b4ca-4858-acad-7f67f4ef4d84', 'cf62572c-aed8-4405-8e2e-513d1f9f3976', 'fb1c245e-fab2-4558-9acb-1f5c9442e963', 'e6c444ae-af25-4279-9215-0b11d2e72a27', '1fe47e7d-d5da-4198-a8d5-ecc0c017948d', 'f8705637-f06c-4d6f-9572-5834d3c02c76', 'e0551ddf-e014-4e0b-b17c-9e30f1dac015', 'efc14d56-7e2f-4186-9451-37adac5c5b23', 'efef42a0-7879-4e5e-b07d-896b827035c2', '5cb5dff3-3fac-48a6-b59f-5932902148b8', 'b3522e3c-b40f-4d43-97bb-6926b26f91d0', '2840b5fb-3a8f-4d93-a381-953dc8e31a67', 'd3e0de07-3f69-422a-b96d-525b1f2d6a80', '55f154d6-8c77-4554-a90c-034e9602b91b', 'fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee', 'bf5386bc-1dac-4dfb-a842-4c99e33f110c', 'e054c2da-0582-423b-9cca-a531d11f58d2', 'a12f01d2-8146-4dc7-b376-a70f9bc9f697'} {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1069.990761] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1070.012718] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.012981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.012981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.013190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.013280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.013391] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1070.013465] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1070.013580] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1070.091871] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.094289] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.094459] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.094511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.094748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.096097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.096445] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1070.096529] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1070.096605] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1070.096675] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1070.096756] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1070.096830] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGH for action security_group_rules [ 1070.096911] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGH for action security_group_rules [ 1070.096980] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGH for action security_group_rules [ 1070.097061] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGH for action security_group_rules [ 1070.097128] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGH for action security_group_rules [ 1070.097237] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGH for action security_group_rules [ 1070.097301] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGH for action security_group_rules [ 1070.097397] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGH for action security_group_rules [ 1070.097464] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGH for action security_group_rules [ 1070.097528] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGH for action security_group_rules [ 1070.097592] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGH for action security_group_rules [ 1070.097657] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGH for action security_group_rules [ 1070.097719] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGH for action security_group_rules [ 1070.097780] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGH for action security_group_rules [ 1070.097842] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGH for action security_group_rules [ 1070.097911] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGH for action security_group_rules [ 1070.097978] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGH for action security_group_rules [ 1070.098066] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGH for action security_group_rules [ 1070.098171] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGH for action security_group_rules [ 1070.098259] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGH for action security_group_rules [ 1070.098379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.155220] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.155220] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.155220] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.155567] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.155738] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.155946] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 not found, creating... [ 1070.156315] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.156498] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.156627] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.156891] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.157074] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.157385] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.157547] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.157669] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.157883] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.158092] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.158250] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 is going to be created. [ 1070.181226] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.181478] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.181636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.182012] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.182347] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.182660] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.201872] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.243629] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.243925] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.244115] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.244479] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.244651] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.244863] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port c8575846-9cad-4667-a9f2-fddffe5b7fe7 not found, creating... [ 1070.245230] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.245480] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.245588] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.245872] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.246057] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.246420] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.246626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.246760] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.247028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.247202] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.247383] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: c8575846-9cad-4667-a9f2-fddffe5b7fe7 is going to be created. [ 1070.267214] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.267440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.267665] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.268668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.268668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.268668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.600019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.600260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.600315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.600512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.600606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.600709] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be updated. [ 1070.632273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.632490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.632490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.632693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.632845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.641015] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: IN_PROGRESS for 2s [ 1070.704702] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.704865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.705047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.705271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.705417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.705470] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1070.739734] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1070.740355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.740544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.740903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.741098] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.741260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.741336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.741933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.741933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.741933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.741933] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.744263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.744381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.744479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.744776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.745023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.759186] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1070.938385] env[69274]: INFO networking_nsxv3.common.synchronization [req-0ca3d531-b51f-464f-9b10-051918d10314 req-b672d7d5-b14e-44d6-9174-18543fbc8c2d service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1070.938659] env[69274]: INFO networking_nsxv3.common.synchronization [req-0ca3d531-b51f-464f-9b10-051918d10314 req-b672d7d5-b14e-44d6-9174-18543fbc8c2d service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1070.938784] env[69274]: INFO networking_nsxv3.common.synchronization [req-0ca3d531-b51f-464f-9b10-051918d10314 req-b672d7d5-b14e-44d6-9174-18543fbc8c2d service nova] Enqueued Resource ID: c8575846-9cad-4667-a9f2-fddffe5b7fe7 with Priority: HIGHEST for action port [ 1070.939384] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1070.939558] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1070.939665] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8575846-9cad-4667-a9f2-fddffe5b7fe7 with Priority: HIGHEST for action port [ 1070.939766] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 with Priority: HIGH for action security_group_rules [ 1070.939888] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGH for action security_group_rules [ 1070.940193] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d with Priority: HIGH for action security_group_rules [ 1070.940193] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a with Priority: HIGH for action security_group_rules [ 1070.940288] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c216e0c6-b262-4569-8d09-772eeaa39501 with Priority: HIGH for action security_group_rules [ 1070.940499] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebac9fe-4ea0-40a1-a949-d690687274d0 with Priority: HIGH for action security_group_rules [ 1070.940499] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 with Priority: HIGH for action security_group_rules [ 1070.940604] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f with Priority: HIGH for action security_group_rules [ 1070.940648] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c76c584-6c00-46aa-955a-014f7c87551a with Priority: HIGH for action security_group_rules [ 1070.940769] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGH for action security_group_rules [ 1070.940860] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGH for action security_group_rules [ 1070.941037] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe with Priority: HIGH for action security_group_rules [ 1070.941037] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGH for action security_group_rules [ 1070.941145] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d with Priority: HIGH for action security_group_rules [ 1070.941223] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e with Priority: HIGH for action security_group_rules [ 1070.941363] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGH for action security_group_rules [ 1070.941500] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a with Priority: HIGH for action security_group_rules [ 1070.941600] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 with Priority: HIGH for action security_group_rules [ 1070.941709] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 with Priority: HIGH for action security_group_rules [ 1070.941803] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 with Priority: HIGH for action security_group_rules [ 1070.942110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.942236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.942329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.942602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.942774] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.943792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.943792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.943992] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8575846-9cad-4667-a9f2-fddffe5b7fe7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.944157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.944213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.944388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.944466] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8575846-9cad-4667-a9f2-fddffe5b7fe7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.946255] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.946255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.946255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.946255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.946255] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118f1c99-f1b0-40d7-b8be-502ee4dd3ac7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.949052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.949052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.949052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.949052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.949052] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.949052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.949052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.949052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.949052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.949052] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f601a42d-d49f-43f8-8ef0-10af2ee0fa8d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.949052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.949579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.949579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.949579] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.949579] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.953447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c216e0c6-b262-4569-8d09-772eeaa39501 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.953447] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c216e0c6-b262-4569-8d09-772eeaa39501',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.953447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cebac9fe-4ea0-40a1-a949-d690687274d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.953447] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cebac9fe-4ea0-40a1-a949-d690687274d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.953447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.953447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.953447] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa1a9a97-83f8-48ba-9ef7-ddec60300629',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.957155] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.957430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.957511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.957728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.957927] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.958771] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c76c584-6c00-46aa-955a-014f7c87551a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.958921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.958996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.960927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.960927] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c76c584-6c00-46aa-955a-014f7c87551a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.960927] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.960927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.960927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.960927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.960927] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.961284] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.961393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.961582] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.961684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.961735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.961873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.961938] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8176f39-b0b7-4ab1-9307-d82b36d10bfe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.962692] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.962830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.962916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.963066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.963143] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.964033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.964176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.964233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.964388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.964557] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dda0f1e4-d4a5-4ea2-b797-7489d5e4067d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.966363] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.966363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.966586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.966663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.966721] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('006dff36-9ba4-4e78-adb7-43e0f38d6a3e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.967454] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.967587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.967657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.967759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.967826] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.968724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.968848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.968902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.969044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.969121] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d18e8e1-0498-42f1-a212-e38138ab2e9a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.969797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.969901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.969967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.970132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.970225] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa3cd7b-c562-43e1-96fe-99002d55eac1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.971269] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.971269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.971269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.971269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.971632] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093f0a21-7741-4a8f-8410-d5b196f0f7d7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.972127] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99b68d96-5b1d-4bdb-9748-7b151abff183 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.972240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.972301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.972455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.972531] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99b68d96-5b1d-4bdb-9748-7b151abff183',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.977261] env[69274]: INFO networking_nsxv3.common.synchronization [req-99d36bf1-0e11-4826-a1f7-5352e4880808 req-c71ba9d0-2e5f-4733-b18d-5be6f9ee2221 service nova] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_rules [ 1070.977436] env[69274]: INFO networking_nsxv3.common.synchronization [req-99d36bf1-0e11-4826-a1f7-5352e4880808 req-c71ba9d0-2e5f-4733-b18d-5be6f9ee2221 service nova] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1070.977580] env[69274]: INFO networking_nsxv3.common.synchronization [req-99d36bf1-0e11-4826-a1f7-5352e4880808 req-c71ba9d0-2e5f-4733-b18d-5be6f9ee2221 service nova] Enqueued Resource ID: e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 with Priority: HIGHEST for action port [ 1070.978515] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_rules [ 1070.978691] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1070.978797] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 with Priority: HIGHEST for action port [ 1070.979278] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.979402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.979473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.979653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.979729] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.980578] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.980680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.980878] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.981041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.981119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.981258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.981330] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3bdedb9-1032-4370-9f5c-1696fd2dc2d6',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.109807] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1071.109993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.110190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.110428] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.110605] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.110725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.110793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.110943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.111043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.111144] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.250292] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.250292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.250292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.250292] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.250697] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.250697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.250697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.251012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.251343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.251472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.251832] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.252164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.252242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.252663] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.253015] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.253393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.253608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.253998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.254284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.254512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.254776] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.440085] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1071.440343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.477417] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8575846-9cad-4667-a9f2-fddffe5b7fe7 with status ACTIVE [ 1071.477757] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.477919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.477990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.478227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.478322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.478504] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.478620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.478678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.478838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.478945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.479108] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.479203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.479263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.479429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.479510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.479596] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8575846-9cad-4667-a9f2-fddffe5b7fe7 is going to be updated. [ 1071.488855] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.489026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.489078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.489234] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.489385] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.489483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.489548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.489695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.489777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.489861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.489948] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.490852] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.490951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.491172] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.491270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.491332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.491492] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.491662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.492181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.492181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.492181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.492181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.492181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.492181] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.492965] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.493126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.495372] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.495485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.495554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.495778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.496441] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.496559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.496630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.496786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.496871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.496959] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.497056] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.498970] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.499079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.507420] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 with status ACTIVE [ 1071.507668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.507824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.507902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.508112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.508205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.508376] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.508475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.508538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.508688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.508767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.508944] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.509058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.509122] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.509264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.509374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.509494] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3bdedb9-1032-4370-9f5c-1696fd2dc2d6 is going to be updated. [ 1071.570775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.570995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.571094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.571380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.573605] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.573791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.574688] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.574787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.575806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.575806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.576772] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.576910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.577777] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.577920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.578766] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.578908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.579854] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.579994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.580921] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.581087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.581962] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.582096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.583094] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.583169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.584082] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.584573] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.584720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.585601] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.586095] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.586247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.587102] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.587594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.587787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.588598] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.589168] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.589316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.590718] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.591327] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.591494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.591644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.591821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.592041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.592282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3bdedb9-1032-4370-9f5c-1696fd2dc2d6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.593181] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.593709] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.593857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.593954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.594229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.594426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.594687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8575846-9cad-4667-a9f2-fddffe5b7fe7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.613754] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.614479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.614795] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c216e0c6-b262-4569-8d09-772eeaa39501 is going to be deleted. [ 1071.616043] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.617042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.617373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.648359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.648512] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99b68d96-5b1d-4bdb-9748-7b151abff183 is going to be deleted. [ 1071.649536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.649809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.691221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.691369] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 006dff36-9ba4-4e78-adb7-43e0f38d6a3e is going to be deleted. [ 1071.692457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.692688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.695068] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1071.695323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.696306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.696562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.696797] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.696930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.697038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.697339] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.697339] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.697431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.697654] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.698813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.699055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.699265] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.699381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.699454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.699606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.699690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.699784] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.744442] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.744614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.749239] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.749387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.757436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.757567] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f is going to be deleted. [ 1071.758560] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1ed1d16-c48a-4859-8659-45390ac1d1a8: rpc.has_security_group_logging(os_id): False [ 1071.759377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.759603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.808854] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.809051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.814721] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.814884] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cebac9fe-4ea0-40a1-a949-d690687274d0 is going to be deleted. [ 1071.815975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.816314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.849133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.849286] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a is going to be deleted. [ 1071.850214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.850441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.882345] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.882424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.899688] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.899939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.905813] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.906161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.920089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.920237] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8176f39-b0b7-4ab1-9307-d82b36d10bfe is going to be deleted. [ 1071.921190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.921494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.968784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.969121] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dda0f1e4-d4a5-4ea2-b797-7489d5e4067d is going to be deleted. [ 1071.970745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.970745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.006467] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.006467] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.006467] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.012497] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.012650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.019138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.019336] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c76c584-6c00-46aa-955a-014f7c87551a is going to be deleted. [ 1072.020564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.020791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.115656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.115798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa3cd7b-c562-43e1-96fe-99002d55eac1 is going to be deleted. [ 1072.116764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.116983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.119510] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.138111] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.138261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.143471] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.143681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.165542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.165691] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d18e8e1-0498-42f1-a212-e38138ab2e9a is going to be deleted. [ 1072.166715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.166948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.180806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.180952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.204557] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.204760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.204984] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.205089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.217619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.217619] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f601a42d-d49f-43f8-8ef0-10af2ee0fa8d is going to be deleted. [ 1072.218535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.218754] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.252126] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.252302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.254925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.255064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118f1c99-f1b0-40d7-b8be-502ee4dd3ac7 is going to be deleted. [ 1072.255954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.256193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.309013] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.309205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.310842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.311541] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093f0a21-7741-4a8f-8410-d5b196f0f7d7 is going to be deleted. [ 1072.312031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.312246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.377097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.377350] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa1a9a97-83f8-48ba-9ef7-ddec60300629 is going to be deleted. [ 1072.378422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.378854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.379116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.379395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c216e0c6-b262-4569-8d09-772eeaa39501" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.379572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.379935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.380078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.380267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99b68d96-5b1d-4bdb-9748-7b151abff183" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.381044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.381384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.456743] env[69274]: INFO networking_nsxv3.common.synchronization [req-30384065-a046-4f49-9855-4e6b16d4b305 req-ae4c6617-8ced-4b39-84ab-3e65447e0cce tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_members [ 1072.457399] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_members [ 1072.457747] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.457892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.458141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.458252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.458437] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.458547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.458615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.458780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.458887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.458985] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.464166] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.464166] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.464166] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.464166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.464676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.464676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.464676] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1072.465457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.465634] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.465715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.465828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-006dff36-9ba4-4e78-adb7-43e0f38d6a3e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.466348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.466534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.466609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.466736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cebac9fe-4ea0-40a1-a949-d690687274d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.466891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.467056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.467137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.467245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e0a2a9b-5bbf-4a4d-9c76-b61af5e0ca2f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.467357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.467495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.467569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.467682] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad63abd6-37fe-4a7e-9f34-4170f6ef5e3a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.468404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.469192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.469192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.469192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8176f39-b0b7-4ab1-9307-d82b36d10bfe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.469192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.469192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.469192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.469612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dda0f1e4-d4a5-4ea2-b797-7489d5e4067d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.469612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.469612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.469612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.469783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c76c584-6c00-46aa-955a-014f7c87551a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.469783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.469915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.484031] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.484031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.487724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.487724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.491723] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.491723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.514925] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75b08f22-c6d6-4014-88bf-a9fe927483cc: rpc.has_security_group_logging(os_id): False [ 1072.514925] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1c536af-bbdd-43d4-96ae-ba31d5403fdb: rpc.has_security_group_logging(os_id): False [ 1072.514925] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fda5f29a-8aee-4dfa-bf8c-4b53899b25f9: rpc.has_security_group_logging(os_id): False [ 1072.554905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.555310] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.555479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.555550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.555812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.556782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.556925] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be updated. [ 1072.558919] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.559133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.559227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.559355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d18e8e1-0498-42f1-a212-e38138ab2e9a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.560701] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.560880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.560880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.561124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.562843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.563045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.564239] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.564356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.596614] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.596863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.623123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.623580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.623580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.623753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.623806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.623882] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1072.634847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.634946] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.635071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.635138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.635362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.635455] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.635551] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 is going to be updated. [ 1072.636809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.636999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.637110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.637240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f601a42d-d49f-43f8-8ef0-10af2ee0fa8d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.637916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.638104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.638193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.638314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093f0a21-7741-4a8f-8410-d5b196f0f7d7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.638531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.638619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.638700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.638820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118f1c99-f1b0-40d7-b8be-502ee4dd3ac7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.638936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.639091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.667857] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.668188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.668188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.671155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.671155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.671155] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: SUCCESS [ 1072.671155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.671155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.671401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.671624] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.671752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.671820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.671985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.672077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.672167] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.675049] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.675049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.705082] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: IN_PROGRESS for 2s [ 1072.710243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.710585] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.710699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.710755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.710968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.711068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.711170] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb is going to be updated. [ 1072.712496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.712724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.744188] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.744463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.744463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.744782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.744862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.751609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.751931] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.752069] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.752128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.752326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.752421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.752520] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc is going to be updated. [ 1072.754317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.754578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.754692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.754931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa3cd7b-c562-43e1-96fe-99002d55eac1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.755083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.755248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.755389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.757058] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1072.757194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.757363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.757448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.757576] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa1a9a97-83f8-48ba-9ef7-ddec60300629" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.768806] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1072.769060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.769219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.769443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.769626] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.769745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.769817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.769951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.770444] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.770444] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.770444] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.776317] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1072.817367] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.817655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.817655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.817823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.817975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.852452] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: IN_PROGRESS for 2s [ 1072.859773] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.859951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.860047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.860814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.860814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.874560] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.874743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.874818] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.875077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.875207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.908496] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: IN_PROGRESS for 2s [ 1072.938028] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: IN_PROGRESS for 2s [ 1072.947758] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.947979] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.948136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.948471] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.948759] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.948930] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.949072] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.949524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.949524] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.949696] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.949836] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.949955] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.950087] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.950209] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.950323] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.950467] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.960940] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.961141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.961185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.961521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.961639] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.961859] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.961968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.962046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.962214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.962294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.962382] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 already deleted. [ 1072.962465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.988235] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.988597] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.988597] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.988749] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.989100] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-f7e24821-37de-466c-9841-3112cc161808 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.989291] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.989419] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.989782] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.989934] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7e24821-37de-466c-9841-3112cc161808',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.176499] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.276816] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.276816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.276816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.277128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.277479] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.277479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.277479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.277633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.277633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.277843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.277926] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.277996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.277996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.278158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.278289] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.278451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.278451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.279289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.279289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.279289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.279289] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.492161] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.492696] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.492985] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.493480] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.493855] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.494188] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port f7e24821-37de-466c-9841-3112cc161808 not found, creating... [ 1073.494681] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.495140] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.495319] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.495752] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.496081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.496604] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.496854] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.497063] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.497400] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.497634] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.497858] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: f7e24821-37de-466c-9841-3112cc161808 is going to be created. [ 1073.523902] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.524160] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.524304] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.524613] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.524868] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.525129] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.678954] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.781105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 1073.800510] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.800510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.800510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.800752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.823342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.823622] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.823763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.823831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.824124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.824208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.824381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.824481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.824575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.824797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.824881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.825110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.825218] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.825314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.825448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.825527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.825629] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1073.926342] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.926632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.926632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.926778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.927019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.957036] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1074.182143] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.182541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.182541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.182847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.183013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.183192] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be updated. [ 1074.227593] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.227828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.227952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.228294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.228525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.250030] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: IN_PROGRESS for 2s [ 1074.715600] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1074.715849] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 deletion is rescheduled due to dependency. [ 1074.716034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.716252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.716536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.716806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.716991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.717669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.717907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.718017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.718135] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.779798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1074.780074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.780327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.780608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.780809] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.780936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.781015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.781178] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.781267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.781356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.781455] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.791321] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1074.791661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.791831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.792013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.792113] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.866194] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: SUCCESS [ 1074.866429] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.920660] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: SUCCESS [ 1074.920928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.953044] env[69274]: INFO networking_nsxv3.common.synchronization [req-30384065-a046-4f49-9855-4e6b16d4b305 req-36d4238e-e136-4203-96c7-32bd030319e3 service nova] Enqueued Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_rules [ 1074.953260] env[69274]: INFO networking_nsxv3.common.synchronization [req-30384065-a046-4f49-9855-4e6b16d4b305 req-36d4238e-e136-4203-96c7-32bd030319e3 service nova] Enqueued Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_members [ 1074.953407] env[69274]: INFO networking_nsxv3.common.synchronization [req-30384065-a046-4f49-9855-4e6b16d4b305 req-36d4238e-e136-4203-96c7-32bd030319e3 service nova] Enqueued Resource ID: f7e24821-37de-466c-9841-3112cc161808 with Priority: HIGHEST for action port [ 1074.953725] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_rules [ 1074.953858] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_members [ 1074.953957] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e24821-37de-466c-9841-3112cc161808 with Priority: HIGHEST for action port [ 1074.954745] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.954858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.954901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.955121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.955210] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.956581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.956761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.956761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.956938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.957129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.957249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.957299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.957548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.957636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.957734] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.958889] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7e24821-37de-466c-9841-3112cc161808 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.959264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.960137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.960137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.960137] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7e24821-37de-466c-9841-3112cc161808',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.962152] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: SUCCESS [ 1074.962152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.221030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.221395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.221395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.221538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.221679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.221926] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.222083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.222176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.222403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.222506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.222648] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be updated. [ 1075.262318] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.262495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.262570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.262814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.262975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.282472] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: IN_PROGRESS for 2s [ 1075.284028] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.284175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.284255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.284495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.284677] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.284784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.284853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.285051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.285211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.285261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.285403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.285499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.285562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.285722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.285923] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.286055] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.286109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.286278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.286382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.286485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.286598] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.294946] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.295147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.295223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.295468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.295667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.295783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.295914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.296100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.296200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.296300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.296413] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.457076] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.457277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.461642] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7e24821-37de-466c-9841-3112cc161808 with status ACTIVE [ 1075.461856] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.461993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.462081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.462307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.462402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.462588] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.462693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.462758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.462907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.462987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.463213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.463369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.463480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.463718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.463805] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.463898] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7e24821-37de-466c-9841-3112cc161808 is going to be updated. [ 1075.465071] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.490922] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.491190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.491338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.491715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.491961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.492249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7e24821-37de-466c-9841-3112cc161808" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.788930] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb1c245e-fab2-4558-9acb-1f5c9442e963: rpc.has_security_group_logging(os_id): False [ 1075.798835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.798987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.799093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.799410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.799587] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.799694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.799757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.799913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.800181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.800316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.800468] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.800578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.800650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.801201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.801201] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.801201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.801201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.801201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.801479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.801479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.801479] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.807013] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.807150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.807212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.807394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.830153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.830471] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.830599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.830668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.830878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.830965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.831221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.831323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.831421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.831546] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.831623] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.831804] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.831898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.831957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.832114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.832192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.832277] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1075.901393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.901393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.901393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.901709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.901709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.916052] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1075.967145] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.992651] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1075.993255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.259740] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: SUCCESS [ 1076.260625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.260625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.260899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.261142] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.261278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.261342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.261531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.261643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.261735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.262302] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.304117] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1ed1d16-c48a-4859-8659-45390ac1d1a8: rpc.has_security_group_logging(os_id): False [ 1076.323651] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.323875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.323921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.324146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.324242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.324446] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.324545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.324674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.324843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.324925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.325148] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.325240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.325414] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.325468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.325509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.325705] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.325797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.325865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.326031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.328645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.328753] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1076.405381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.405696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.405696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.405858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.405927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.425220] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1076.477935] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.478206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.478304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.479034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.479034] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.479034] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 is going to be created. [ 1076.541421] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.541421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.541421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.541421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.541665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.555406] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 in Status: UNINITIALIZED for 2s [ 1076.764232] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.764435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.764529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.764840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.765093] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.765239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.765321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.765609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.765609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.765772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.765934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.766058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.766304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.766304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.766472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.766538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.766605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.766763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.766846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.766941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.767047] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.269259] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1fe47e7d-d5da-4198-a8d5-ecc0c017948d: rpc.has_security_group_logging(os_id): False [ 1077.309669] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1077.309844] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 deletion is rescheduled due to dependency. [ 1077.310625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.310625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.310625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.310625] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.311057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.311057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.311057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.311167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.311297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.311496] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8705637-f06c-4d6f-9572-5834d3c02c76 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.311638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.311978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.311978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.316464] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.316464] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.316464] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.316464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.344447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.344447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.344447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.344447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.344606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.344692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.344894] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.345032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.345101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.345272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.345370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.345573] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.345689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.345781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.345955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.350093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.350093] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be updated. [ 1077.490048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.490555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.490627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.490846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.491190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.508766] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: IN_PROGRESS for 2s [ 1077.819874] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8705637-f06c-4d6f-9572-5834d3c02c76: rpc.has_security_group_logging(os_id): False [ 1077.841667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.841850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.841895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.842106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.842196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.842422] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.842516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.842583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.842801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.842880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.843081] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.843197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.843263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.843405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.843477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.843722] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.843816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.843875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.844832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.844832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.844832] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be updated. [ 1077.926813] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.926813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.926813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.926813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.926813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.945930] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1077.945930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.946509] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: IN_PROGRESS for 2s [ 1078.447208] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1078.447598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.564957] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 in Status: SUCCESS [ 1078.565508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.565567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.565937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.566238] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.566421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.566678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.566920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.566920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.566920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.567121] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.076426] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.525884] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: SUCCESS [ 1079.525884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.581251] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a455007-3894-4ad6-ba01-21ddec4b0019: rpc.has_security_group_logging(os_id): False [ 1079.624199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.624199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.624199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.624199] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 is going to be created. [ 1079.705826] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.706085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.706085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.706507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.706581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.720250] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 in Status: IN_PROGRESS for 2s [ 1079.955106] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1079.955287] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1079.963957] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8705637-f06c-4d6f-9572-5834d3c02c76 in Status: SUCCESS [ 1079.963957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.963957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.964191] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.964326] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8705637-f06c-4d6f-9572-5834d3c02c76',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.489078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.489253] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.489316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.489578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.489705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.489813] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8705637-f06c-4d6f-9572-5834d3c02c76 is going to be deleted. [ 1080.549534] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.549873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.549873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.550076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.550159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.550324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8705637-f06c-4d6f-9572-5834d3c02c76" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.190036] env[69274]: INFO networking_nsxv3.common.synchronization [None req-f747a1eb-bcaa-4edd-8eea-4c796e04bb80 None None] Enqueued Resource ID: 4ea04308-00d1-421c-9b9c-ed8ee0e8c1de with Priority: HIGHEST for action port [ 1081.190036] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea04308-00d1-421c-9b9c-ed8ee0e8c1de with Priority: HIGHEST for action port [ 1081.190036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ea04308-00d1-421c-9b9c-ed8ee0e8c1de taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.190036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ea04308-00d1-421c-9b9c-ed8ee0e8c1de" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.190036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ea04308-00d1-421c-9b9c-ed8ee0e8c1de" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.191988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ea04308-00d1-421c-9b9c-ed8ee0e8c1de" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.191988] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ea04308-00d1-421c-9b9c-ed8ee0e8c1de',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.694539] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ea04308-00d1-421c-9b9c-ed8ee0e8c1de [ 1081.694539] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.694539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.694539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.694539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.694539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.694539] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ea04308-00d1-421c-9b9c-ed8ee0e8c1de already deleted. [ 1081.696265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ea04308-00d1-421c-9b9c-ed8ee0e8c1de" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.741230] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 in Status: SUCCESS [ 1081.741531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.671852] env[69274]: INFO networking_nsxv3.common.synchronization [None req-adbd5be9-43d4-4ad7-9535-7be77b3ed639 None None] Enqueued Resource ID: 8f4ce3dd-bc46-4c54-ac54-90f51c85814f with Priority: HIGHEST for action port [ 1083.672520] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f4ce3dd-bc46-4c54-ac54-90f51c85814f with Priority: HIGHEST for action port [ 1083.675299] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f4ce3dd-bc46-4c54-ac54-90f51c85814f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.675299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f4ce3dd-bc46-4c54-ac54-90f51c85814f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.675299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f4ce3dd-bc46-4c54-ac54-90f51c85814f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.675299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f4ce3dd-bc46-4c54-ac54-90f51c85814f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.675299] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f4ce3dd-bc46-4c54-ac54-90f51c85814f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.697311] env[69274]: INFO networking_nsxv3.common.synchronization [req-93ee4c13-4d9d-4c3c-b8a8-98468bfe36ed req-ddb852cf-1953-483c-ac4f-4948cfaef336 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1083.699025] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1083.699025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.699246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.699246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.699363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.699566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.700497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.701103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.701326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.701418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.701544] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.176876] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f4ce3dd-bc46-4c54-ac54-90f51c85814f [ 1084.177263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.177442] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.177539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.177790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.177884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.178183] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f4ce3dd-bc46-4c54-ac54-90f51c85814f already deleted. [ 1084.178411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f4ce3dd-bc46-4c54-ac54-90f51c85814f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.203781] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.632528] env[69274]: INFO networking_nsxv3.common.synchronization [None req-e6f5be24-1d75-4008-8971-dad2e1cf1540 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1084.633438] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1084.633844] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.633978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.706119] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.974030] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa594a2d-46bb-4239-abc0-a7f4ff35dd96 req-73c8772f-d805-4241-a180-80942adf99d0 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1084.974713] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1084.975129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.975263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.975344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.975611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.975792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.976172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.976172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.976172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.976300] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.976362] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.211853] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.211853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.211853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.211853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.211853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.211853] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1085.251094] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.251313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.251458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.251660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.251811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.262160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1085.381049] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.381209] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.381392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.381754] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.383890] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.384072] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.384211] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.384503] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.384674] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.384906] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.385041] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.385163] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.385279] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.385398] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.385511] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.385655] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.410639] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.410639] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1085.410639] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.410639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-114" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.410639] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-39166345-9f7f-402e-96a3-8016657073d8 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.410639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.410639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.410639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.410639] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39166345-9f7f-402e-96a3-8016657073d8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.484040] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.913825] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.914187] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.914231] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.914527] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.914710] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.914890] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 39166345-9f7f-402e-96a3-8016657073d8 not found, creating... [ 1085.915189] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.915361] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.915487] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.915729] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.915880] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.916297] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.916491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.916626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.916879] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.917047] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.917204] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 39166345-9f7f-402e-96a3-8016657073d8 is going to be created. [ 1085.938259] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.938479] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.938600] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.939046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.939368] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.939610] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.984433] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.487700] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.487955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.488068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.488382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.488524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.488699] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1086.531673] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.531891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.531944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.532245] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.532402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.559641] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1086.710021] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa594a2d-46bb-4239-abc0-a7f4ff35dd96 req-4fea1a2f-6acb-4225-919c-e061eadd8637 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 1086.710239] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa594a2d-46bb-4239-abc0-a7f4ff35dd96 req-4fea1a2f-6acb-4225-919c-e061eadd8637 service nova] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1086.710406] env[69274]: INFO networking_nsxv3.common.synchronization [req-aa594a2d-46bb-4239-abc0-a7f4ff35dd96 req-4fea1a2f-6acb-4225-919c-e061eadd8637 service nova] Enqueued Resource ID: 39166345-9f7f-402e-96a3-8016657073d8 with Priority: HIGHEST for action port [ 1086.710645] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_rules [ 1086.710816] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1086.710888] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39166345-9f7f-402e-96a3-8016657073d8 with Priority: HIGHEST for action port [ 1086.711765] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.711950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.712047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.712348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.712464] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.713752] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.713826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.714071] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-39166345-9f7f-402e-96a3-8016657073d8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.714251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.714251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.714464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.714517] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39166345-9f7f-402e-96a3-8016657073d8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.216630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.216944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.216981] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39166345-9f7f-402e-96a3-8016657073d8 with status ACTIVE [ 1087.217234] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.217337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.217433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.217661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.217753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.217938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.218052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.218118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.218254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.218331] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.218508] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.218602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.218660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.218798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.218872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.218954] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39166345-9f7f-402e-96a3-8016657073d8 is going to be updated. [ 1087.264954] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.265711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.265711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.265711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.265711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.265711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39166345-9f7f-402e-96a3-8016657073d8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272721] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1087.272923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.273095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.273285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.273462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.273570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.273636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.273855] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.273939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.274045] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.776117] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.779065] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.779065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.779065] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1087.808838] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.810071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.810071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.810071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.810071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.819591] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1088.572195] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1088.572516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.572673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.572914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.573163] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.573315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.573392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.573585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.573724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.573796] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.798487] env[69274]: INFO networking_nsxv3.common.synchronization [req-a98fa072-93bc-4133-8ece-93e11832fe50 req-9b066112-e114-48dd-8ae7-ada9940606b1 tempest-ImagesTestJSON-1117667709 tempest-ImagesTestJSON-1117667709-project-member] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1088.798487] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGHEST for action security_group_members [ 1088.798487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.798487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.798487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.798853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.798853] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.798853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.799601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.799867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.800010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.801202] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.076973] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.305839] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.305839] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.305839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.305839] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be updated. [ 1089.338270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.338404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.338477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.338690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.338832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.348401] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: IN_PROGRESS for 2s [ 1089.579646] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.831291] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1089.831513] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 deletion is rescheduled due to dependency. [ 1089.831643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.877614] env[69274]: INFO networking_nsxv3.common.synchronization [req-7bf3965e-58e8-4a47-96fb-9d9e929535c6 req-60e0b842-c41f-450f-ac2c-5a014662780f tempest-InstanceActionsNegativeTestJSON-1047971569 tempest-InstanceActionsNegativeTestJSON-1047971569-project-member] Enqueued Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_members [ 1089.879450] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_members [ 1089.879784] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.879930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.880033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.880321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.880535] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.880674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.880783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.881052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.881112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.881214] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.083265] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.083404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.083485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.083782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.083955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.084099] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1090.116868] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.117124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.117124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.117312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.117457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.126488] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1090.250701] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.250928] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-978" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.251054] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-978" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.251407] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-978" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.251720] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.251949] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.252056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.252287] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.252439] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.252657] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.252809] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.252932] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.253062] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.253184] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.253297] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.253437] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.272550] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.272735] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.272884] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.273147] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-978" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.273485] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-a19d3c6b-772a-4c46-8526-83b559e558a9 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.273759] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.273900] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.274291] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.274441] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a19d3c6b-772a-4c46-8526-83b559e558a9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.388389] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.388505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.388539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.388756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.388847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.389211] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.389317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.389350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.389590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.389724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.389857] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 already deleted. [ 1090.389966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.777043] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.777528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.777528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.777785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.777944] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.778116] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port a19d3c6b-772a-4c46-8526-83b559e558a9 not found, creating... [ 1090.778393] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.778559] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.778682] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.778915] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.779094] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.779394] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.779559] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.779682] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.779985] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.780100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.780247] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: a19d3c6b-772a-4c46-8526-83b559e558a9 is going to be created. [ 1090.801938] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.802266] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.802359] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.802612] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.802847] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.803102] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.359542] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 in Status: SUCCESS [ 1091.359769] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 deletion is rescheduled due to dependency. [ 1091.359859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.536810] env[69274]: INFO networking_nsxv3.common.synchronization [req-7bf3965e-58e8-4a47-96fb-9d9e929535c6 req-e9a7c062-864b-4213-a7a7-04190cbd0cfc service nova] Enqueued Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_rules [ 1091.537141] env[69274]: INFO networking_nsxv3.common.synchronization [req-7bf3965e-58e8-4a47-96fb-9d9e929535c6 req-e9a7c062-864b-4213-a7a7-04190cbd0cfc service nova] Enqueued Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_members [ 1091.537320] env[69274]: INFO networking_nsxv3.common.synchronization [req-7bf3965e-58e8-4a47-96fb-9d9e929535c6 req-e9a7c062-864b-4213-a7a7-04190cbd0cfc service nova] Enqueued Resource ID: a19d3c6b-772a-4c46-8526-83b559e558a9 with Priority: HIGHEST for action port [ 1091.537945] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_rules [ 1091.538158] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_members [ 1091.538224] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a19d3c6b-772a-4c46-8526-83b559e558a9 with Priority: HIGHEST for action port [ 1091.538579] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.538727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.538773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.539077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.539262] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.540403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.540403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.540719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.540719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.540977] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.541154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.541658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.541658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.541658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.541798] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.546855] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a19d3c6b-772a-4c46-8526-83b559e558a9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.547029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.547159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.547340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.547427] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a19d3c6b-772a-4c46-8526-83b559e558a9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.051324] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.051324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.051324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.052548] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a19d3c6b-772a-4c46-8526-83b559e558a9 with status ACTIVE [ 1092.052708] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.053517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.053517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.053517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.053517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.053866] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.054047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.054498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.054498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.054498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.054830] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.054918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.055229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.055229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.055393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.055450] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a19d3c6b-772a-4c46-8526-83b559e558a9 is going to be updated. [ 1092.083664] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.083901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.084049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.084284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.084465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.084680] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a19d3c6b-772a-4c46-8526-83b559e558a9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.138852] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1092.138852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.139061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.139193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.139400] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.139522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.139590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.139748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.140103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.140103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.140103] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.553361] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.642937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.643146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.643205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.643677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.643959] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.644092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.644162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.644343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.644436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.644533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.644682] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.644772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.644838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.644976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.645132] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.645227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.645287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.645422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.645499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.645583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.645674] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.056021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.056400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.056400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.056521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.056618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.056813] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 is going to be created. [ 1093.083377] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.083563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.083630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.083982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.084138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.095404] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 in Status: UNINITIALIZED for 2s [ 1093.149819] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd7d0f6f-e583-4619-be1a-10cbd86bd911: rpc.has_security_group_logging(os_id): False [ 1093.184195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.184195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.184195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.184195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.186048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.186048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.186048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.186048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.186048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.186048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.186048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.186048] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1093.302971] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.302971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.302971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.303215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.303398] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.355686] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1093.838015] env[69274]: INFO networking_nsxv3.common.synchronization [req-b678bfc3-728e-4f02-902a-dbb3eb789306 req-74d7acd7-09af-467e-a946-03493637f899 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_members [ 1093.838786] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e054c2da-0582-423b-9cca-a531d11f58d2 with Priority: HIGHEST for action security_group_members [ 1093.839283] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e054c2da-0582-423b-9cca-a531d11f58d2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.839422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.839461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.839668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.839856] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.839976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.840051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.841060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.841060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.841060] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e054c2da-0582-423b-9cca-a531d11f58d2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.344023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.344023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.344023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.344023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.369636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.369909] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.370173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.370173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.370315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.370391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.370683] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e054c2da-0582-423b-9cca-a531d11f58d2 is going to be updated. [ 1094.401383] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.401577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.401667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.401948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.403070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.411752] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e054c2da-0582-423b-9cca-a531d11f58d2 in Status: IN_PROGRESS for 2s [ 1095.107687] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 in Status: SUCCESS [ 1095.107687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.107848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.107962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.108270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.108270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.108360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.108558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.108558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.108671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.108825] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.373884] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1095.373884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.611530] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.611785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.611872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.612154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.612337] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.612446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.612512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.612670] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.612765] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.612857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.613030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.613125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.613185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.613325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.613462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.613552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.613611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.613789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.613869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.613942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.614048] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.012430] env[69274]: INFO networking_nsxv3.common.synchronization [req-37e0677f-b236-44d4-88d3-220e171eda62 req-48a2eaca-476b-4a43-a442-dd117bddec0c tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1096.012650] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1096.016495] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.016653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.016708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.016947] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.017158] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.017270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.017332] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.017423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.017545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.017600] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.118726] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0cfaaa6-931d-4c7a-9f80-bc3fea212be2: rpc.has_security_group_logging(os_id): False [ 1096.149380] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.149660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.149732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.150687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.150809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.151125] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.151288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.151363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.151656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.151817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.151997] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.152160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.152200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.152340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.152426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.152659] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.152767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.152827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.152980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.153076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.153173] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 is going to be created. [ 1096.225990] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.226266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.226383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.226749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.227154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.256243] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 in Status: IN_PROGRESS for 2s [ 1096.424625] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e054c2da-0582-423b-9cca-a531d11f58d2 in Status: SUCCESS [ 1096.424625] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e054c2da-0582-423b-9cca-a531d11f58d2 deletion is rescheduled due to dependency. [ 1096.424625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e054c2da-0582-423b-9cca-a531d11f58d2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.523270] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.523270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.523270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.523584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.549028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.549287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.549458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.549551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.550074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.550285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.550482] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1096.585039] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.585039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.585039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.585039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.585039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.595914] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1098.270030] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 in Status: SUCCESS [ 1098.270413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.606982] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1098.607233] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1098.607380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.095435] env[69274]: INFO networking_nsxv3.common.synchronization [None req-6656e7bd-cff1-4ae3-b415-1c10fa17bd24 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1099.095948] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1099.096821] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.096960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.097031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.097283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.097359] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.198795] env[69274]: INFO networking_nsxv3.common.synchronization [None req-3b567f7c-15ea-402a-bf82-bdbe68b40915 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1099.199536] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1099.199993] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.201945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.561312] env[69274]: INFO networking_nsxv3.common.synchronization [req-5f178473-cf83-4d3c-8563-6b7ff6eccfa5 req-7b531bdb-79ff-4f82-abe1-1368b2722d35 tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 1099.561312] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGHEST for action security_group_members [ 1099.561312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.561312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.561312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.561979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.561979] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.562173] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.562629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.562629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.562899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.562959] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.625482] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.625482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.625482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.625482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.625482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.625482] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 already deleted. [ 1099.625482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.625482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.625482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.625482] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.066779] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.066947] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.067035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.067270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.067369] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.067579] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.067710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.067778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.067939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.068032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.068129] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb is going to be updated. [ 1100.097577] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.097747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.097786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.097991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.098157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.107378] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: IN_PROGRESS for 2s [ 1100.148556] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.148747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.148747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.148939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.149041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.149138] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 already deleted. [ 1100.149225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.812279] env[69274]: INFO networking_nsxv3.common.synchronization [req-440234fd-582c-4201-b28b-3f7fba019ca3 req-13e8d5b9-af99-4da7-bd8e-3561cc1430cc tempest-ServerRescueTestJSON-2125380106 tempest-ServerRescueTestJSON-2125380106-project-member] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1100.812279] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1100.812560] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.812560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.812560] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.812750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.812835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.813219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.813219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.813219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.813409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.813409] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.315422] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.818281] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.887217] env[69274]: INFO networking_nsxv3.common.synchronization [req-aba264d7-d2df-4d9b-aab8-7edbd89232fb req-3585fed4-d2cf-46ea-9fd5-4eac61399575 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1101.887217] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1101.887217] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.887217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.887217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.887217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.888414] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.888646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.888836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.889098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.889269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.889476] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.972353] env[69274]: INFO networking_nsxv3.common.synchronization [req-442a313b-80ec-40b9-94b3-660002582585 req-1921434f-1c2c-40b1-81ca-fcca20101e6c tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_members [ 1101.972979] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGHEST for action security_group_members [ 1101.977060] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.977060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.977060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.977060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.977060] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.977060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.977060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.977060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.977060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.977060] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.118646] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb in Status: SUCCESS [ 1102.118882] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb deletion is rescheduled due to dependency. [ 1102.119042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.323561] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.323742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.323878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.324177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.324445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.324445] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be updated. [ 1102.356912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.357147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.357147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.357396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.357515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.370209] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: IN_PROGRESS for 2s [ 1102.393109] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.477837] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.477837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.477837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.478107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.478107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.479048] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.479048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.479048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.479048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.479279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.479279] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc is going to be updated. [ 1102.510626] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.510801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.510844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.511078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.511232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.521139] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: IN_PROGRESS for 2s [ 1102.894399] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.397710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.397921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.397921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.398115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.398213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.398322] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1103.426035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.426035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.426035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.426304] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.426432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.436594] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1103.655951] env[69274]: INFO networking_nsxv3.common.synchronization [req-e60fe2ff-acf6-4b96-ae8c-084b233c2c57 req-6727ac4f-895e-4b7c-8668-3ffe578ec22e tempest-InstanceActionsNegativeTestJSON-1047971569 tempest-InstanceActionsNegativeTestJSON-1047971569-project-member] Enqueued Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_members [ 1103.656456] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGHEST for action security_group_members [ 1103.656765] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.656894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.656963] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.657238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.657421] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.657491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.657557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.657708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.657794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.657917] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.938015] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2e03ede-ad1a-4047-96d2-7f79862aac89 req-42f681bb-a40b-4985-b4d0-adf30f836690 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1103.938537] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1103.938842] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.938983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.939064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.939275] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.939429] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.939524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.939584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.939733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.939820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.939917] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.162472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.162472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.162472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.162605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.163187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.163187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.163187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.163187] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.163506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.163506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.163771] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 is going to be updated. [ 1104.214910] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.214910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.214910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.214910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.215224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.225772] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 in Status: IN_PROGRESS for 2s [ 1104.287779] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.287985] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.288141] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.288415] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.288680] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.288839] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.288963] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.289231] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.289407] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.289585] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.289703] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.289825] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.289942] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.290064] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.290178] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.290317] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.319547] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.319736] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.319902] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.320070] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.320409] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-3711ecd5-e809-4018-932b-0b995b98c75d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.320620] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.320720] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.321147] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.321343] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3711ecd5-e809-4018-932b-0b995b98c75d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.380377] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: SUCCESS [ 1104.380603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.443913] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.443913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.443913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.443913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.443913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.444236] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.444288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.444322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.444476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.444557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.444647] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1104.471170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.471351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.471445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.471574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.471719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.480277] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1104.530795] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc in Status: SUCCESS [ 1104.530983] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc deletion is rescheduled due to dependency. [ 1104.531123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.824378] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.824615] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.824710] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.825067] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.825247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.825415] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 3711ecd5-e809-4018-932b-0b995b98c75d not found, creating... [ 1104.825689] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.826069] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.826069] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.826347] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.826583] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.826805] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.826970] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.827109] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.827329] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.827474] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.827627] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 3711ecd5-e809-4018-932b-0b995b98c75d is going to be created. [ 1104.851479] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.851897] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.851986] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.852289] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.852525] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.852764] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.446615] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1105.447023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.517737] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2e03ede-ad1a-4047-96d2-7f79862aac89 req-90038f9d-0702-4364-b7c4-1467be4a8d40 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1105.517934] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2e03ede-ad1a-4047-96d2-7f79862aac89 req-90038f9d-0702-4364-b7c4-1467be4a8d40 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1105.518105] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2e03ede-ad1a-4047-96d2-7f79862aac89 req-90038f9d-0702-4364-b7c4-1467be4a8d40 service nova] Enqueued Resource ID: 3711ecd5-e809-4018-932b-0b995b98c75d with Priority: HIGHEST for action port [ 1105.518326] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1105.518460] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1105.518562] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3711ecd5-e809-4018-932b-0b995b98c75d with Priority: HIGHEST for action port [ 1105.519635] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.519777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.519856] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.520067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.520155] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.521743] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.521846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.523211] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-3711ecd5-e809-4018-932b-0b995b98c75d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.523211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.523211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.523211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.523211] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3711ecd5-e809-4018-932b-0b995b98c75d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.024066] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.024205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.024414] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3711ecd5-e809-4018-932b-0b995b98c75d with status ACTIVE [ 1106.024586] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.024692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.025827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.025827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.025827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.025827] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.025827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.025827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.025827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.025827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.025827] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.026569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.026569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.026569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.026569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.026569] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3711ecd5-e809-4018-932b-0b995b98c75d is going to be updated. [ 1106.049722] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.049722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.049722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.049722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.049722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.049722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3711ecd5-e809-4018-932b-0b995b98c75d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.243375] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 in Status: SUCCESS [ 1106.243375] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 deletion is rescheduled due to dependency. [ 1106.243375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.460332] env[69274]: INFO networking_nsxv3.common.synchronization [None req-82eeaca2-75e6-414e-a028-f755564d05c1 tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1106.460903] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1106.461313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.461443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.461518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.461789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.461900] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.489912] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1106.490105] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1106.490226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.490659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.490913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.491123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.491239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.491306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.491458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.491545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.491632] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.528503] env[69274]: INFO networking_nsxv3.common.synchronization [None req-7fab76b4-e67c-46a5-8abd-0b29a3b4f072 tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1106.528999] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1106.529324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.529433] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.982023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.982192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.982268] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.982494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.982587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.982687] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 already deleted. [ 1106.982773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.982926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.983101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.983184] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.994040] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.496191] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.502807] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.502949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.503030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.503264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.503384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.503458] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 already deleted. [ 1107.503561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.999226] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.999343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.999412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.999625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.999710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.999818] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1108.031773] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.032215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.032215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.032374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.032374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.041084] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1108.052142] env[69274]: INFO networking_nsxv3.common.synchronization [req-616dfe4f-65cd-461c-825b-c3de8eaca54d req-28a0cb04-ffd6-49e3-839b-92d5e2cf4a55 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1108.052142] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1108.052379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.052956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.052956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.052956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.052956] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.053198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.053274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.053438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.053555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.053615] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.377995] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.378464] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.378464] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.378693] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.379030] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.379185] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.379358] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.379547] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.379764] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.379984] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.380130] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.380251] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.380366] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.380484] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1108.380597] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.380737] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.402819] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.403040] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1108.403169] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.403359] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.403681] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.403983] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.404133] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.404450] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.404596] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a305fa6-cb17-4f57-a3ff-8a33d1039fff',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.555506] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.555983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.555983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.555983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.555983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.556214] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.556338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.556401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.556557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.556650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.556739] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 already deleted. [ 1108.556823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.907544] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.907788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.907936] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.908311] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.908552] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.908739] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 5a305fa6-cb17-4f57-a3ff-8a33d1039fff not found, creating... [ 1108.909027] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.909202] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.909329] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.909569] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.909717] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.910017] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.910190] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.910329] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.910579] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.910726] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.910877] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 5a305fa6-cb17-4f57-a3ff-8a33d1039fff is going to be created. [ 1108.931853] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.932090] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.932227] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.932512] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.932757] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.933006] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.719565] env[69274]: INFO networking_nsxv3.common.synchronization [req-616dfe4f-65cd-461c-825b-c3de8eaca54d req-0dd0a14e-d429-48eb-84b1-c1ed97a64c76 service nova] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1109.719565] env[69274]: INFO networking_nsxv3.common.synchronization [req-616dfe4f-65cd-461c-825b-c3de8eaca54d req-0dd0a14e-d429-48eb-84b1-c1ed97a64c76 service nova] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1109.719565] env[69274]: INFO networking_nsxv3.common.synchronization [req-616dfe4f-65cd-461c-825b-c3de8eaca54d req-0dd0a14e-d429-48eb-84b1-c1ed97a64c76 service nova] Enqueued Resource ID: 5a305fa6-cb17-4f57-a3ff-8a33d1039fff with Priority: HIGHEST for action port [ 1109.719565] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1109.719565] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1109.720138] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a305fa6-cb17-4f57-a3ff-8a33d1039fff with Priority: HIGHEST for action port [ 1109.720669] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.721114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.722277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.722277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.722277] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.723997] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.724311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.724656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.725283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.728518] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.728518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.728518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.728518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.728518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.728518] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.729896] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.730267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.730863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.731391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.731691] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a305fa6-cb17-4f57-a3ff-8a33d1039fff',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.049967] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1110.050222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.050388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.050613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.050803] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.050922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.051020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.051182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.051267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.051354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.051444] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.224779] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.225096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.231728] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.234106] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a305fa6-cb17-4f57-a3ff-8a33d1039fff with status ACTIVE [ 1110.234309] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.234435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.234503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.234711] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.234798] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.235147] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.235280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.235335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.235516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.235604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.235804] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.235909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.235961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.236125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.236203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.236288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a305fa6-cb17-4f57-a3ff-8a33d1039fff is going to be updated. [ 1110.257659] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.257869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.257869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.258121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.258263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.258421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a305fa6-cb17-4f57-a3ff-8a33d1039fff" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.553553] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.553723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.553796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.554140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.554324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.554438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.554515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.554660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.554751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.554861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.555052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.555179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.555243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.555387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.555529] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.555620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.555683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.555819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.555899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.555981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.556087] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.732451] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.059571] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf62572c-aed8-4405-8e2e-513d1f9f3976: rpc.has_security_group_logging(os_id): False [ 1111.077501] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.077708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.077708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.077929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.078056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.078300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.078397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.078460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.078618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.078700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.078874] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.078974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.079042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.079184] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.079258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.079447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.079541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.079606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.079734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.079902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.079902] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1111.140042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.140212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.140276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.140464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.140703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.160288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1111.235161] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.235376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.235376] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.235646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.235701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.235794] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 is going to be created. [ 1111.269542] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.269794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.269794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.269967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.270149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.279942] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: UNINITIALIZED for 2s [ 1112.089573] env[69274]: INFO networking_nsxv3.common.synchronization [req-0349c4fb-c66c-49f4-bbc7-f88beeea24de req-14bb313c-6755-47f3-89e2-276c104bfb47 tempest-ServerRescueTestJSON-2125380106 tempest-ServerRescueTestJSON-2125380106-project-member] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1112.090879] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGHEST for action security_group_members [ 1112.090879] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.090879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.091033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.091279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.091480] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.091633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.091778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.091939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.092099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.092257] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.595097] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.595097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.595097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.595097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.595097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.595453] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.595453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.595543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.595672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.595750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.595839] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be updated. [ 1112.624075] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.624075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.624075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.624075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.624347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.640019] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: IN_PROGRESS for 2s [ 1113.183824] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1113.184189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.296816] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: SUCCESS [ 1113.297063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.297243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.297471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.297675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.297786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.297902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.298017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.298109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.298189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.298282] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.800262] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.305100] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93500972-b84b-40e5-abe8-7eeafad09413: rpc.has_security_group_logging(os_id): False [ 1114.326395] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.326575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.326669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.326946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.327102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.327411] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.327580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.327672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.327918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.327990] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.328147] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 is going to be created. [ 1114.403472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.403622] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.403697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.404050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.404282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.416114] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: IN_PROGRESS for 2s [ 1114.458205] env[69274]: INFO networking_nsxv3.common.synchronization [req-0cb97a54-8cd6-42d9-8cad-bb799cf82817 req-6b115bea-535b-4180-9801-700a081f25c5 tempest-ServersTestJSON-525982737 tempest-ServersTestJSON-525982737-project-member] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1114.458205] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGHEST for action security_group_members [ 1114.458423] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.458541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.458607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.458797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.458956] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.459195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.459266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.459439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.459524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.459615] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.650334] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d in Status: SUCCESS [ 1114.650528] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d deletion is rescheduled due to dependency. [ 1114.650658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.962659] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.962886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.962886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.963113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.963211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.963419] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.963523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.963588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.963745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.963822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.964069] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be updated. [ 1114.991348] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.991543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.991543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.991715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.991902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.000642] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: IN_PROGRESS for 2s [ 1116.429796] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: SUCCESS [ 1116.429796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.013066] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 in Status: SUCCESS [ 1117.013251] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 deletion is rescheduled due to dependency. [ 1117.013364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.961468] env[69274]: INFO networking_nsxv3.common.synchronization [req-1d494ff8-4980-4e6f-9b54-dbea58275211 req-fb5b0a50-f48b-4002-a5d1-ccd8be8b9fac tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1118.963922] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1118.963922] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.963922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.963922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.963922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.963922] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.963922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.963922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.963922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.963922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.963922] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.465806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.466117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.466182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.466411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.466523] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.466763] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.466896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.466969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.467244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.467313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.467379] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1119.505100] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.505312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.505312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.505525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.505669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.515179] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1120.427895] env[69274]: INFO networking_nsxv3.common.synchronization [req-0c15f295-625a-490a-9df1-3c47d5f1cf68 req-988d33e4-295f-4ece-8b0d-25fae1f3e3c0 tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1120.428794] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1120.430345] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.430494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.430557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.430800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.430976] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.431127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.431179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.431351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.431463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.431547] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.828165] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.828165] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.828165] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.828485] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.828813] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.829083] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.829244] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.829492] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.829716] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.829980] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.830154] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.830302] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.830423] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.830543] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.830657] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.830841] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.851103] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.851296] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1120.851438] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.851629] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.851999] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.852224] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.852351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.852687] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.852836] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8ff0a0-a82b-4129-ae4b-9e03c7be3799',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.933382] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.933566] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.933609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.933800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.933893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.934147] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.934250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.934311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.934470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.934549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.934638] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 already deleted. [ 1120.934720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.355485] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.355485] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.355639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.355890] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.356066] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.356313] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 not found, creating... [ 1121.356714] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.356907] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.357079] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.357343] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.357643] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.357910] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.358112] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.358246] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.358497] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.358648] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.358798] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 is going to be created. [ 1121.379316] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.379503] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.379573] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.379851] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.380153] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.380413] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.526786] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1121.527265] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1121.527265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.123329] env[69274]: INFO networking_nsxv3.common.synchronization [req-0c15f295-625a-490a-9df1-3c47d5f1cf68 req-7aa8fcc8-ff7b-4387-a1fd-9b4b5f7a7056 service nova] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1122.123329] env[69274]: INFO networking_nsxv3.common.synchronization [req-0c15f295-625a-490a-9df1-3c47d5f1cf68 req-7aa8fcc8-ff7b-4387-a1fd-9b4b5f7a7056 service nova] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1122.123329] env[69274]: INFO networking_nsxv3.common.synchronization [req-0c15f295-625a-490a-9df1-3c47d5f1cf68 req-7aa8fcc8-ff7b-4387-a1fd-9b4b5f7a7056 service nova] Enqueued Resource ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 with Priority: HIGHEST for action port [ 1122.123635] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1122.123744] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1122.123835] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 with Priority: HIGHEST for action port [ 1122.124331] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.127939] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.127939] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.127939] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.127939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.127939] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.129769] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.131211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.131291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.131651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.131651] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8ff0a0-a82b-4129-ae4b-9e03c7be3799',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.634255] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.635519] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.635717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.637299] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 with status ACTIVE [ 1122.637549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.638409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.638409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.638409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.638409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.638409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.638752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.638752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.639743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.639743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.639743] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.639743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.639743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.639743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.639743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.639743] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 is going to be updated. [ 1122.660843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.661085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.661085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.661306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.661466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.661629] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.137749] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.640632] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.641028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.641126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.641553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.641705] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.641873] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 is going to be created. [ 1123.666719] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.666888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.666936] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.667150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.667306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.678216] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: UNINITIALIZED for 2s [ 1125.690096] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: SUCCESS [ 1125.690473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.690521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.690910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.693533] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.693686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.693763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.694012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.694119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.694203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.694300] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.063890] env[69274]: INFO networking_nsxv3.common.synchronization [None req-5897ea6c-1421-480b-8db2-d250e7de92dc None None] Enqueued Resource ID: 60acec01-dc6d-45df-ba37-109f9c3438f7 with Priority: HIGHEST for action port [ 1126.064239] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60acec01-dc6d-45df-ba37-109f9c3438f7 with Priority: HIGHEST for action port [ 1126.064821] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-60acec01-dc6d-45df-ba37-109f9c3438f7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.064950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60acec01-dc6d-45df-ba37-109f9c3438f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.065082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60acec01-dc6d-45df-ba37-109f9c3438f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.065355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60acec01-dc6d-45df-ba37-109f9c3438f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.065355] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60acec01-dc6d-45df-ba37-109f9c3438f7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.199043] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.568726] env[69274]: INFO networking_nsxv3.common.synchronization [req-b9d464e0-e786-4bf0-b62e-6b6c89e9d9f2 req-126de900-65db-47fe-936c-85809c085f83 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 1126.568963] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60acec01-dc6d-45df-ba37-109f9c3438f7 [ 1126.569219] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.569407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.569407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.569750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.569750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.569750] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60acec01-dc6d-45df-ba37-109f9c3438f7 already deleted. [ 1126.569852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60acec01-dc6d-45df-ba37-109f9c3438f7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.570318] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 1126.570633] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.570820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.570820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.571103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.571301] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.571395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.571395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.571782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.571929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.571929] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.704038] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b037ccd-78b0-43be-acdd-bcc8531b52f5: rpc.has_security_group_logging(os_id): False [ 1126.727452] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.727724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.727724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.728073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.728073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.728267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.728401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.728473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.728635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.728712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.728800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 is going to be created. [ 1126.794124] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.794326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.794375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.794587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.794778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.809972] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: IN_PROGRESS for 2s [ 1127.059801] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.060054] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.060171] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.060459] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.060725] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.060914] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.061173] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.061435] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.061598] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.061820] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.061942] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.062074] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.062196] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.062314] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.062432] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.062594] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.074843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.075050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.075109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.075293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.082727] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.082909] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.083083] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.083264] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.083584] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-c527fc2a-0ccd-4178-a6fc-77fd4915244d taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.083762] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.083889] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.084296] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.084451] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c527fc2a-0ccd-4178-a6fc-77fd4915244d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.095926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.096703] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.096703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.096703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.096703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.096703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.097023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be updated. [ 1127.128508] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.128688] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.128767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.129079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.129274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.141013] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: IN_PROGRESS for 2s [ 1127.586705] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.587253] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.587334] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.587690] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.587922] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.588187] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port c527fc2a-0ccd-4178-a6fc-77fd4915244d not found, creating... [ 1127.588558] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.588799] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.588999] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.591531] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.593044] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.593044] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.593044] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.593044] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.593342] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.593382] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.593586] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: c527fc2a-0ccd-4178-a6fc-77fd4915244d is going to be created. [ 1127.614985] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.615426] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.615620] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.615908] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.616190] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.616439] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.312369] env[69274]: INFO networking_nsxv3.common.synchronization [req-b9d464e0-e786-4bf0-b62e-6b6c89e9d9f2 req-bf3c0fe5-92ff-4943-8c8c-98c6e0b81fb8 service nova] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_rules [ 1128.312369] env[69274]: INFO networking_nsxv3.common.synchronization [req-b9d464e0-e786-4bf0-b62e-6b6c89e9d9f2 req-bf3c0fe5-92ff-4943-8c8c-98c6e0b81fb8 service nova] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 1128.312369] env[69274]: INFO networking_nsxv3.common.synchronization [req-b9d464e0-e786-4bf0-b62e-6b6c89e9d9f2 req-bf3c0fe5-92ff-4943-8c8c-98c6e0b81fb8 service nova] Enqueued Resource ID: c527fc2a-0ccd-4178-a6fc-77fd4915244d with Priority: HIGHEST for action port [ 1128.312369] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_rules [ 1128.312369] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 1128.312369] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c527fc2a-0ccd-4178-a6fc-77fd4915244d with Priority: HIGHEST for action port [ 1128.314187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.314669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.314815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.315143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.316079] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.317281] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.317281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.317566] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c527fc2a-0ccd-4178-a6fc-77fd4915244d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.317671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.317671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.317834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.317914] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c527fc2a-0ccd-4178-a6fc-77fd4915244d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.493665] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b18efa4f-c3ec-4553-834d-403425f8dc66 None None] Enqueued Resource ID: 6cd9ecc2-b116-4092-899e-a60c1768d4a0 with Priority: HIGHEST for action port [ 1128.494314] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd9ecc2-b116-4092-899e-a60c1768d4a0 with Priority: HIGHEST for action port [ 1128.494503] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cd9ecc2-b116-4092-899e-a60c1768d4a0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.494630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cd9ecc2-b116-4092-899e-a60c1768d4a0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.494694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cd9ecc2-b116-4092-899e-a60c1768d4a0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.494954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cd9ecc2-b116-4092-899e-a60c1768d4a0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.495056] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cd9ecc2-b116-4092-899e-a60c1768d4a0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.820472] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c527fc2a-0ccd-4178-a6fc-77fd4915244d with status ACTIVE [ 1128.820804] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.820953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.821047] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.821368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.821439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.821642] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.821780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.821884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.822158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.822266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.822452] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.822555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.822619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.822764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.822857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.822989] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c527fc2a-0ccd-4178-a6fc-77fd4915244d is going to be updated. [ 1128.824577] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.824764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.825581] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: SUCCESS [ 1128.825782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.847500] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.847500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.847692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.847796] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.847942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.848155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.997101] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cd9ecc2-b116-4092-899e-a60c1768d4a0 [ 1128.997392] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.997540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.997612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.997831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.997937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.998058] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cd9ecc2-b116-4092-899e-a60c1768d4a0 already deleted. [ 1128.998147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cd9ecc2-b116-4092-899e-a60c1768d4a0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.151389] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: SUCCESS [ 1129.151631] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 deletion is rescheduled due to dependency. [ 1129.152060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.152060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.152257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.152459] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.152568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.152630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.152774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.152858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.152956] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.656624] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.159311] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.569667] env[69274]: INFO networking_nsxv3.common.synchronization [req-d101199d-739c-403a-abd9-e648e740a07d req-110c8131-8d51-4596-a548-cef1e31d1d31 tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1130.570949] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1130.571899] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.572119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.572232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.573192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.573446] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.573626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.573703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.573895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.574074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.574181] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.662921] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.663704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.663704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.663704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.663704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.663704] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be updated. [ 1130.694320] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.694464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.694536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.694763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.695082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.704125] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: IN_PROGRESS for 2s [ 1131.079209] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.079209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.079209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.079209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.106135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.106135] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.106135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.106135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.106135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.106135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.106135] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1131.135221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.135221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.135221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.135221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.135221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.143974] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1131.148692] env[69274]: INFO networking_nsxv3.common.synchronization [req-e13b6f19-be8c-4c8b-955f-5afc4a3a0e9a req-dbaca730-abcc-4b86-b930-5ef97198b5fd tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1131.149293] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1131.153607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.153607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.153607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.153607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.154422] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.154603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.154638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.154808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.154904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.155011] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.661059] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.075114] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.075114] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.075114] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.075114] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.075114] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.075978] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.076319] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.076685] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.076983] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.077372] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.077642] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.077891] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.078148] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.078421] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.078847] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.079171] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.099389] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.100353] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.100718] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.101071] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.102155] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fd06f188-ab67-48ff-b752-9092393febe3 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.103037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.103037] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.103176] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.103361] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd06f188-ab67-48ff-b752-9092393febe3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.162934] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.606657] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.606938] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.607092] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.607393] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.607567] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.607718] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port fd06f188-ab67-48ff-b752-9092393febe3 not found, creating... [ 1132.608401] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.608631] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.608719] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.608961] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.609157] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.609477] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.609643] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.609767] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.609990] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.610145] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.610296] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fd06f188-ab67-48ff-b752-9092393febe3 is going to be created. [ 1132.630648] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.630648] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.630864] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.632029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.632029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.632029] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.665903] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.666104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.666177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.666427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.666527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.666633] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 is going to be updated. [ 1132.714016] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: SUCCESS [ 1132.714401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.714628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.714886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.715150] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.715470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.715599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.715784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.715902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.716033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.716166] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.724148] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.724315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.724391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.724598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.724743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.736939] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: IN_PROGRESS for 2s [ 1133.169836] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1133.169836] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 deletion is rescheduled due to dependency. [ 1133.170809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.222312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.222312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.222312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.222312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.222312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.223186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.223186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.223186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.223186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.223186] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.354652] env[69274]: INFO networking_nsxv3.common.synchronization [req-e13b6f19-be8c-4c8b-955f-5afc4a3a0e9a req-62bd93a3-3f4c-436e-8940-35135ef7ac68 service nova] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1133.354652] env[69274]: INFO networking_nsxv3.common.synchronization [req-e13b6f19-be8c-4c8b-955f-5afc4a3a0e9a req-62bd93a3-3f4c-436e-8940-35135ef7ac68 service nova] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1133.354652] env[69274]: INFO networking_nsxv3.common.synchronization [req-e13b6f19-be8c-4c8b-955f-5afc4a3a0e9a req-62bd93a3-3f4c-436e-8940-35135ef7ac68 service nova] Enqueued Resource ID: fd06f188-ab67-48ff-b752-9092393febe3 with Priority: HIGHEST for action port [ 1133.354652] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_rules [ 1133.354652] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1133.354652] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd06f188-ab67-48ff-b752-9092393febe3 with Priority: HIGHEST for action port [ 1133.354652] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.354652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.354652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.354934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.354966] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.356244] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.356430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.356557] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd06f188-ab67-48ff-b752-9092393febe3 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.356630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.356692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.356885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.356973] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd06f188-ab67-48ff-b752-9092393febe3',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.724198] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 425a6912-a0c6-4fca-8187-80a58f8e7880: rpc.has_security_group_logging(os_id): False [ 1133.742037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.742182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.742260] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.742480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.742575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.742796] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.742896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.742981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.743180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.743265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.743467] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.743565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.743627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.743768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.743846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.744069] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.744196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.744240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.744354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.744431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.744519] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be updated. [ 1133.807877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.808044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.808119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.808322] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.808470] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.822095] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: IN_PROGRESS for 2s [ 1133.858808] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.859085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.859182] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd06f188-ab67-48ff-b752-9092393febe3 with status ACTIVE [ 1133.859359] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.859513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.859583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.859800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.859895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.860105] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.860204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.860272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.861060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.861060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.861060] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.861060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.861060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.861060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.861060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.861367] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd06f188-ab67-48ff-b752-9092393febe3 is going to be updated. [ 1133.891675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.891852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.891935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.892287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.892488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.892667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd06f188-ab67-48ff-b752-9092393febe3" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.752931] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: SUCCESS [ 1134.753280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.753324] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.753586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.753820] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.753987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.754169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.754365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.754476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.754607] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.257201] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.758758] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.841253] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: SUCCESS [ 1135.841553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.261836] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.262045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.262250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.262481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.262575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.262681] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 is going to be updated. [ 1136.292256] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.292451] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.292521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.292694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.292844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.302502] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: IN_PROGRESS for 2s [ 1137.200745] env[69274]: INFO networking_nsxv3.common.synchronization [req-95e1c711-4c14-4c6f-b62a-1a88628f566a req-5e1afe66-f27f-4685-b560-d778a9c681e9 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 1137.201444] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGHEST for action security_group_members [ 1137.201857] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.201995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.202146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.202432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.202636] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.202771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.202858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.203070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.203172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.203272] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.255527] env[69274]: INFO networking_nsxv3.common.synchronization [req-95e1c711-4c14-4c6f-b62a-1a88628f566a req-5e1afe66-f27f-4685-b560-d778a9c681e9 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: c527fc2a-0ccd-4178-a6fc-77fd4915244d with Priority: HIGHEST for action port [ 1137.256212] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c527fc2a-0ccd-4178-a6fc-77fd4915244d with Priority: HIGHEST for action port [ 1137.256621] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c527fc2a-0ccd-4178-a6fc-77fd4915244d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.256982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.256982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.257281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.257411] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c527fc2a-0ccd-4178-a6fc-77fd4915244d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.706219] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.706487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.706487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.706695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.706791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.707019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.707131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.707193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.707471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.707471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.707806] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be updated. [ 1137.728734] env[69274]: INFO networking_nsxv3.common.synchronization [req-bdb664cf-71e1-4752-ba7f-dc7c2dfc41ab req-0f272068-5cc4-4a9c-844b-57ca0ca47efc tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1137.729375] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1137.729700] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.729831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.729902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.730197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.730375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.730533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.730592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.730773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.730833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.730975] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.746780] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.746780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.746888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.747150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.748393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.759837] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: IN_PROGRESS for 2s [ 1137.760108] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c527fc2a-0ccd-4178-a6fc-77fd4915244d with status ACTIVE [ 1137.760320] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.760445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.760515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.760737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.760825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.761043] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.761217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.761317] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.761533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.761627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.761812] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.765026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.765026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.765026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.765026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.765026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c527fc2a-0ccd-4178-a6fc-77fd4915244d is going to be updated. [ 1137.799731] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.799731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.799731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.799731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.799731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.799731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c527fc2a-0ccd-4178-a6fc-77fd4915244d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.113985] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.113985] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.114198] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.114642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.114836] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.115056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.115140] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.115819] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.115819] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.115819] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.115958] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.115958] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.116101] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.117269] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.117439] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.118460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.139954] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.140166] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.140319] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.140518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.140857] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d015212e-619c-43db-99de-220331b10e56 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.141053] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.141188] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.141636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.141788] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d015212e-619c-43db-99de-220331b10e56',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.233675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.233970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.233970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.234387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.234527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.234773] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.234892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.234943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.235199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.235311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.235418] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2339818-d892-4139-9105-430d1c6dde2e already deleted. [ 1138.235505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.317011] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: SUCCESS [ 1138.317395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.317649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.317909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.318434] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.318569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.318624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.318802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.318915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.318993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.319101] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.648392] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.648392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.648392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.648392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.648392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.648392] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port d015212e-619c-43db-99de-220331b10e56 not found, creating... [ 1138.648784] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.648977] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.649032] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.649275] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.649430] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.649792] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.649954] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.650094] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.650344] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.650495] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.650649] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d015212e-619c-43db-99de-220331b10e56 is going to be created. [ 1138.674104] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.674445] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.674585] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.674931] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.675256] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.675545] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.822016] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.159813] env[69274]: INFO networking_nsxv3.common.synchronization [req-985aa6af-6dda-4f7e-a2e3-7f2827f05e48 req-ad6ca77d-8401-4054-85c0-ba1822971932 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_members [ 1139.159965] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGHEST for action security_group_members [ 1139.160402] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.160590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.160756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.161010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.161182] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.161290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.161356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.161510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.161596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.161692] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.325587] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93500972-b84b-40e5-abe8-7eeafad09413: rpc.has_security_group_logging(os_id): False [ 1139.351441] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.352326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.352445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.352675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.352838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.353392] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.353392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.353551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.353772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.353920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.354170] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 is going to be updated. [ 1139.418662] env[69274]: INFO networking_nsxv3.common.synchronization [req-bdb664cf-71e1-4752-ba7f-dc7c2dfc41ab req-757ea80e-3661-43e9-8cb3-b16e573c571d service nova] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_rules [ 1139.420532] env[69274]: INFO networking_nsxv3.common.synchronization [req-bdb664cf-71e1-4752-ba7f-dc7c2dfc41ab req-757ea80e-3661-43e9-8cb3-b16e573c571d service nova] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1139.420532] env[69274]: INFO networking_nsxv3.common.synchronization [req-bdb664cf-71e1-4752-ba7f-dc7c2dfc41ab req-757ea80e-3661-43e9-8cb3-b16e573c571d service nova] Enqueued Resource ID: d015212e-619c-43db-99de-220331b10e56 with Priority: HIGHEST for action port [ 1139.420532] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_rules [ 1139.420532] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1139.420532] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d015212e-619c-43db-99de-220331b10e56 with Priority: HIGHEST for action port [ 1139.420532] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.421426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.421426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.421426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.421581] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.423542] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.423542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.423542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.425077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.425077] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.425077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.425077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.425077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.425077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.425077] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.427615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d015212e-619c-43db-99de-220331b10e56 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.427615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.427615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.427615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.427615] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d015212e-619c-43db-99de-220331b10e56',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.433728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.433909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.433971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.435574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.435574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.475263] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: IN_PROGRESS for 2s [ 1139.665650] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.665811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.665905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.666221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.666388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.666643] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.666773] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.666841] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.667070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.667175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.667301] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 is going to be updated. [ 1139.702739] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.702739] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.703091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.703091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.703361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.712554] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 in Status: IN_PROGRESS for 2s [ 1139.772571] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 in Status: SUCCESS [ 1139.772754] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 deletion is rescheduled due to dependency. [ 1139.772874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.924418] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.924590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.928994] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d015212e-619c-43db-99de-220331b10e56 with status ACTIVE [ 1139.929312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.929467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.929537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.929753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.929847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.930087] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.930192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.930268] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.930464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.930541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.930727] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.930820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.930885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.931105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.931105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.931189] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d015212e-619c-43db-99de-220331b10e56 is going to be updated. [ 1139.932511] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.956168] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.956168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.956168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.956702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.956702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.956702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d015212e-619c-43db-99de-220331b10e56" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.010975] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3937569-4a44-44bd-8326-12bd1e974519 req-a4d3d249-f32d-4f47-9d6b-f4a2276bc84f tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1140.011744] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1140.012254] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.012425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.366858] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.367200] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.367200] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.367477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.367828] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.368014] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.368152] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.368383] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.368540] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.368749] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.368870] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.368985] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.369114] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.369231] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.369346] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.369493] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.399673] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.399881] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.400248] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.400695] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.401180] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.401551] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.403054] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.403054] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.403054] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.436690] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.907046] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.907046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.907046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.907046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.907046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.907046] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe not found, creating... [ 1140.907046] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.907046] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.907611] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.907973] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.908259] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.908716] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.909051] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.909292] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.909616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.910045] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.910438] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe is going to be created. [ 1140.936919] env[69274]: INFO networking_nsxv3.common.synchronization [req-12700717-8c9c-47e9-8ffd-ebcce68b8f69 req-76dfb26d-b22e-4107-9ba6-10408020dc1a tempest-ServersV294TestFqdnHostnames-424206970 tempest-ServersV294TestFqdnHostnames-424206970-project-member] Enqueued Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_members [ 1140.937673] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGHEST for action security_group_members [ 1140.940036] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.940036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.940036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.940377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.940570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.940634] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be created. [ 1140.942119] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.942237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.942272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.943593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.943593] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.943593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.943593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.943593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.943593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.943593] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.987670] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.988086] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.988246] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.988676] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.989035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.990185] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.993156] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.993355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.993456] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.993742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.994042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.008241] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: UNINITIALIZED for 2s [ 1141.447764] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.448280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.448280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.448548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.478506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.478920] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.479199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.479278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.479513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.479638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.479764] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 is going to be updated. [ 1141.499120] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: SUCCESS [ 1141.499323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.525487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.525487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.525487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.525487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.525487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.534201] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 644d845b-e0e5-49b2-b970-585c199651e8 in Status: IN_PROGRESS for 2s [ 1141.725304] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 in Status: SUCCESS [ 1141.725490] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 deletion is rescheduled due to dependency. [ 1141.725609] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.780267] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3937569-4a44-44bd-8326-12bd1e974519 req-af58a9c5-ec30-4688-a97c-2f71f3d445f2 service nova] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_rules [ 1141.780267] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3937569-4a44-44bd-8326-12bd1e974519 req-af58a9c5-ec30-4688-a97c-2f71f3d445f2 service nova] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1141.780267] env[69274]: INFO networking_nsxv3.common.synchronization [req-d3937569-4a44-44bd-8326-12bd1e974519 req-af58a9c5-ec30-4688-a97c-2f71f3d445f2 service nova] Enqueued Resource ID: 51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe with Priority: HIGHEST for action port [ 1141.780267] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_rules [ 1141.780267] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1141.780267] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe with Priority: HIGHEST for action port [ 1141.780267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.780267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.780960] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.781195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.781582] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.781838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.781995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.782312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.782529] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.285559] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe with status ACTIVE [ 1142.290229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.290229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.290229] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.290229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.290229] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe is going to be updated. [ 1142.318807] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.318807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.318807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.318807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.318807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.318807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51aba2c6-7ea7-4d99-9548-a4c2af2dc2fe" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.688128] env[69274]: INFO networking_nsxv3.common.synchronization [req-9f289f4a-8671-46dd-81c8-5b11670361b6 req-eb47212a-0958-4d52-80c7-33b987d5af02 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1142.688128] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1142.688128] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.688128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.688128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.688128] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.689178] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.689443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.689659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.689932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.690160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.690357] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.018492] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1143.018708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.018874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.019745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.019745] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.019745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.019745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.019745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.019745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.019745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.020396] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.020708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.020874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.021061] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.021170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.021232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.021370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.021446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.021531] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.055654] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.056099] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.056348] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.056707] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.057084] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.057419] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.057661] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.057978] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.060776] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.060776] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.060776] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.060776] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.060776] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.060776] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.060776] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.060776] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.081512] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.081871] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.082138] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.082419] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.082845] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-216beb8c-366e-4f3f-8b69-128acd2397dc taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.084020] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.084020] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.084020] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.084020] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('216beb8c-366e-4f3f-8b69-128acd2397dc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.187853] env[69274]: INFO networking_nsxv3.common.synchronization [None req-553f24de-419d-4839-aae9-d8055276239f tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1143.188429] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1143.188762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.188910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.188991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.189436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.189619] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.189718] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.189782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.189987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.190147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.190306] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.192662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.192960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.193050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.193182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.193294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.193667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.193857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.193857] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.194029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.194196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.194342] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1143.226287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.226527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.226527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.226879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.226879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.239271] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1143.524023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.524384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.524479] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.546281] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 644d845b-e0e5-49b2-b970-585c199651e8 in Status: SUCCESS [ 1143.546929] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 deletion is rescheduled due to dependency. [ 1143.546929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.590139] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.590139] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 216beb8c-366e-4f3f-8b69-128acd2397dc not found, creating... [ 1143.590139] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.590139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.590668] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.590668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.590668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.590668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.590668] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.590668] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 216beb8c-366e-4f3f-8b69-128acd2397dc is going to be created. [ 1143.614330] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.614330] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.614330] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.614330] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.614330] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.614330] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.694033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.694419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.694601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.694962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.695241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.695581] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.695820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.695965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.696263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.696439] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.696710] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1143.730750] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.730918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.730918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.731472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.731472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.743741] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1144.027342] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.533110] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.533879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.533879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.533879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.533879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.533879] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be updated. [ 1144.541259] env[69274]: INFO networking_nsxv3.common.synchronization [req-9f289f4a-8671-46dd-81c8-5b11670361b6 req-3f7c9c04-17e6-447f-b234-428d2dafece2 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1144.541259] env[69274]: INFO networking_nsxv3.common.synchronization [req-9f289f4a-8671-46dd-81c8-5b11670361b6 req-3f7c9c04-17e6-447f-b234-428d2dafece2 service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1144.541259] env[69274]: INFO networking_nsxv3.common.synchronization [req-9f289f4a-8671-46dd-81c8-5b11670361b6 req-3f7c9c04-17e6-447f-b234-428d2dafece2 service nova] Enqueued Resource ID: 216beb8c-366e-4f3f-8b69-128acd2397dc with Priority: HIGHEST for action port [ 1144.541397] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1144.542038] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1144.542038] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 216beb8c-366e-4f3f-8b69-128acd2397dc with Priority: HIGHEST for action port [ 1144.542038] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.542269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.542269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.542415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.542514] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.543551] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.543668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.543922] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-216beb8c-366e-4f3f-8b69-128acd2397dc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.544058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.544147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.544378] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.544478] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('216beb8c-366e-4f3f-8b69-128acd2397dc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.573277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.573277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.573277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.573277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.573277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.583753] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 2s [ 1145.050076] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.050076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.050076] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 216beb8c-366e-4f3f-8b69-128acd2397dc with status ACTIVE [ 1145.050447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.050447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.050447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.050799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.050968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.051287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.051450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.051559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.051822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.051965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.052403] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.053023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.053023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.053023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.053163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.053228] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 216beb8c-366e-4f3f-8b69-128acd2397dc is going to be updated. [ 1145.078395] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.078678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.078795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.079024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.079222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.079374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-216beb8c-366e-4f3f-8b69-128acd2397dc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.253582] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1145.253897] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1145.254207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.254481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.254799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.255151] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.255280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.255341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.255520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.255607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.255709] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.754984] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1145.754984] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 deletion is rescheduled due to dependency. [ 1145.754984] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.759123] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.261281] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.305871] env[69274]: INFO networking_nsxv3.common.synchronization [None req-f22c11e8-733b-4dc7-9c34-4e2d57a61332 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_rules [ 1146.305871] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_rules [ 1146.305871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.307207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.307423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.308153] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.308364] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.412681] env[69274]: INFO networking_nsxv3.common.synchronization [None req-1840e312-2a06-4bb9-9c85-63925c1c3575 tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_rules [ 1146.413327] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_rules [ 1146.413738] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.413873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.595692] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1146.595944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.596131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.596893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.596893] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.596893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.596893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.597277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.597277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.597477] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.762860] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.763082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.763203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.763474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.763575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.763690] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1146.799165] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.799165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.799165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.799165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.799165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.811730] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1146.839347] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.839619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.839804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.840196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.840412] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.840777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42671b00-adb1-46b6-9948-92a484306fcc already deleted. [ 1146.840850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.841220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.841485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.841786] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.100432] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.298696] env[69274]: INFO networking_nsxv3.common.synchronization [req-65077bfa-2058-4dec-a788-b084938cb6e2 req-97ab61f8-4fe5-4f1f-b0ae-1cbc3da14349 tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1147.299605] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1147.299753] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.299918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.299918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.300197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.300340] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.300462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.300528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.300708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.300914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.301065] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.369603] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.369603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.369603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.369603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.369603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.369603] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42671b00-adb1-46b6-9948-92a484306fcc already deleted. [ 1147.369603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.603189] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.806314] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.806314] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.806314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.806314] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1147.841142] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.844360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.844360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.844360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.844360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.854805] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1147.893334] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.893334] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.893334] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.893653] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.893964] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.895433] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.895433] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.895433] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.895433] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.895433] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.895433] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.895433] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.895433] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.895433] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.895833] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.895833] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.916395] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.916582] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.916731] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.916920] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.917287] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d16b1e5b-3252-489f-830f-f66e5ae29d31 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.917558] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.917606] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.918010] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.918258] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16b1e5b-3252-489f-830f-f66e5ae29d31',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.111065] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.111065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.111065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.111391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.111530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.111624] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be updated. [ 1148.143116] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.143396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.143396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.143556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.143708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.153357] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 2s [ 1148.421270] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.421681] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.421681] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.421944] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.422206] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.422389] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port d16b1e5b-3252-489f-830f-f66e5ae29d31 not found, creating... [ 1148.422724] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.422911] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.423063] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.423780] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.423780] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.423780] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.424016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.424083] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.424409] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.424599] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.424757] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 is going to be created. [ 1148.446366] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.446629] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.446938] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.447422] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.447889] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.448155] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.822358] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1148.822789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.822789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.822974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.823172] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.823290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.823349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.823538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.823624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.823685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.823743] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.329999] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.330280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.330399] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.330764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.331091] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.331248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.331351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.331607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.331742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.332469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.332469] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.332469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.332469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.332753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.332806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.332953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.333142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.333391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.333524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.333649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.333784] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.743680] env[69274]: INFO networking_nsxv3.common.synchronization [req-65077bfa-2058-4dec-a788-b084938cb6e2 req-531f663e-3c2e-468e-960b-28df730d47a5 service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 1149.743963] env[69274]: INFO networking_nsxv3.common.synchronization [req-65077bfa-2058-4dec-a788-b084938cb6e2 req-531f663e-3c2e-468e-960b-28df730d47a5 service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1149.744045] env[69274]: INFO networking_nsxv3.common.synchronization [req-65077bfa-2058-4dec-a788-b084938cb6e2 req-531f663e-3c2e-468e-960b-28df730d47a5 service nova] Enqueued Resource ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 with Priority: HIGHEST for action port [ 1149.744766] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 1149.744941] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1149.745073] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 with Priority: HIGHEST for action port [ 1149.745448] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.745549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.745600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.745880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.746044] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.746541] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.746649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.746871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d16b1e5b-3252-489f-830f-f66e5ae29d31 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.746993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.747061] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.747255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.747347] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16b1e5b-3252-489f-830f-f66e5ae29d31',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.837448] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf62572c-aed8-4405-8e2e-513d1f9f3976: rpc.has_security_group_logging(os_id): False [ 1149.859902] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.860150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.860419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.860542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.860709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.861296] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.861514] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.861514] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.861733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.861844] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.862071] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.862283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.862367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.862578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.862694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.863702] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.863702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.863702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.863702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.863702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.863702] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1149.874270] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1149.874547] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 deletion is rescheduled due to dependency. [ 1149.874671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.874829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.878044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.878044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.878044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.878044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.878044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.878044] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.878044] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.952546] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.952744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.952867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.953140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.953347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.982628] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1150.167106] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 4s [ 1150.250286] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d16b1e5b-3252-489f-830f-f66e5ae29d31 with status ACTIVE [ 1150.250632] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.250922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.250986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.251243] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.251379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.251635] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.251771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.251901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.252607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.252607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.252607] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.252607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.252811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.252811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.252894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.253019] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 is going to be updated. [ 1150.254373] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.254461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.275317] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.276677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.276677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.276677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.276677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.276677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.381262] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.886055] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.391023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.391023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.391023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.391023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.391023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.391023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1151.431068] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.431068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.431068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.431068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.431068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.441936] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1152.009511] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1152.009774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.186299] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1152.186552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.186780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.187045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.187287] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.187464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.187569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.187793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.187907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.188096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.188237] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.188349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.188413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.188569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.188738] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.188871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.188980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.190028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.190214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.190294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.190432] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.365941] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.366242] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.366443] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.366913] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.367784] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.368068] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.368272] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.368608] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.368864] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.369273] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.369519] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.369607] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.369765] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.370399] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.370399] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.370399] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.391418] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.391687] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1152.391855] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.392067] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.392410] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fe561928-8b58-4b50-9b19-9469ae406eb2 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.392630] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.392694] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.393034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.393210] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe561928-8b58-4b50-9b19-9469ae406eb2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.694381] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2339818-d892-4139-9105-430d1c6dde2e: rpc.has_security_group_logging(os_id): False [ 1152.713937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.714338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.714415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.714707] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.714866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.715141] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.715247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.715335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.715517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.715605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.715798] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.715896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.715960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.716488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.716488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.716708] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.716842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.716932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.717119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.717349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.717491] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be created. [ 1152.774394] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.774585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.774625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.774826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.775027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.787362] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 2s [ 1152.895817] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.896078] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.896218] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.896577] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.896735] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.896901] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port fe561928-8b58-4b50-9b19-9469ae406eb2 not found, creating... [ 1152.897196] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.897363] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.897488] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.897726] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.897872] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.898181] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.898899] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.898899] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.899103] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.899268] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.899406] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fe561928-8b58-4b50-9b19-9469ae406eb2 is going to be created. [ 1152.924245] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.924245] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.924245] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.924245] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.924245] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.924245] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.452496] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1153.452842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.453078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.453400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.453687] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.453860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.453953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.455748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.456296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.456296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.456296] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.512449] env[69274]: INFO networking_nsxv3.common.synchronization [req-b4a0d5cb-a92f-447d-99a5-a7fe1cfa2680 req-1917c677-726f-4437-abd9-e28ffcf7c4eb tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_members [ 1153.515254] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_members [ 1153.519044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.520119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.520437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.520890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.521305] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.521565] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.521751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.522513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.522727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.522938] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.958316] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.033353] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.033353] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.033353] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42671b00-adb1-46b6-9948-92a484306fcc already deleted. [ 1154.033353] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.097121] env[69274]: INFO networking_nsxv3.common.synchronization [req-9b811627-49f6-4255-b735-e70971873f02 req-285001d4-966b-4c22-b180-c8c2e0c2dd84 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1154.097368] env[69274]: INFO networking_nsxv3.common.synchronization [req-9b811627-49f6-4255-b735-e70971873f02 req-285001d4-966b-4c22-b180-c8c2e0c2dd84 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1154.097546] env[69274]: INFO networking_nsxv3.common.synchronization [req-9b811627-49f6-4255-b735-e70971873f02 req-285001d4-966b-4c22-b180-c8c2e0c2dd84 service nova] Enqueued Resource ID: fe561928-8b58-4b50-9b19-9469ae406eb2 with Priority: HIGHEST for action port [ 1154.098138] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1154.098302] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1154.098402] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe561928-8b58-4b50-9b19-9469ae406eb2 with Priority: HIGHEST for action port [ 1154.098704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.098829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.098898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.099119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.099232] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.100084] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.100606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.100684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.100870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.101038] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.101440] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.101499] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.101725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.101725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.101820] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.103198] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe561928-8b58-4b50-9b19-9469ae406eb2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.103364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.103364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.103519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.103589] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe561928-8b58-4b50-9b19-9469ae406eb2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.266938] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.267783] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.267783] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.267783] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.267929] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.267984] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.268418] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.268712] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.269388] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.269388] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1154.269388] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.269388] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.269674] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.269795] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1154.270094] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.270179] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.294541] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.294710] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1154.294841] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.295019] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-689" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.295387] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-234b7d55-418e-4712-ad4a-88d99af22471 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.295574] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.295703] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.297313] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.297313] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('234b7d55-418e-4712-ad4a-88d99af22471',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.418065] env[69274]: INFO networking_nsxv3.common.synchronization [None req-09a855fe-a32c-4140-8161-a839606c9fca None None] Enqueued Resource ID: 65098329-2480-40b8-82f8-d22fa1181b8e with Priority: HIGHEST for action port [ 1154.418065] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65098329-2480-40b8-82f8-d22fa1181b8e with Priority: HIGHEST for action port [ 1154.418194] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-65098329-2480-40b8-82f8-d22fa1181b8e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.418602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65098329-2480-40b8-82f8-d22fa1181b8e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.418602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65098329-2480-40b8-82f8-d22fa1181b8e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.418762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65098329-2480-40b8-82f8-d22fa1181b8e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.418762] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65098329-2480-40b8-82f8-d22fa1181b8e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.461332] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15291f2b-281c-4bf0-a609-bcb369c82f51: rpc.has_security_group_logging(os_id): False [ 1154.484615] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.484752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.484807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.485017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.485132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.485373] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.485468] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.485551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.485733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.485809] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.485895] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1154.554997] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.555358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.555358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.555559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.555804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.572705] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1154.604474] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.605622] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe561928-8b58-4b50-9b19-9469ae406eb2 with status ACTIVE [ 1154.605938] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.606143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.606257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.606578] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.606717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.607083] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.607257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.607328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.607544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.607715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.607967] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.608144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.608254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.608486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.608654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.608742] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe561928-8b58-4b50-9b19-9469ae406eb2 is going to be updated. [ 1154.610375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.610375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.631489] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.631778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.631851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.632163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.632358] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.632624] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.799482] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.799700] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.799829] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.800245] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.800433] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.800596] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 234b7d55-418e-4712-ad4a-88d99af22471 not found, creating... [ 1154.800888] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.801078] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.801204] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.801449] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.801703] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.801986] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.802198] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.802340] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.802575] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.802722] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.803468] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 234b7d55-418e-4712-ad4a-88d99af22471 is going to be created. [ 1154.806678] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1154.806928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.807181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.807485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.807629] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.832681] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.832910] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.833059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.833368] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.834479] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.834479] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.920961] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65098329-2480-40b8-82f8-d22fa1181b8e [ 1154.921879] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.922974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.922974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.922974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.922974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.922974] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65098329-2480-40b8-82f8-d22fa1181b8e already deleted. [ 1154.922974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65098329-2480-40b8-82f8-d22fa1181b8e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.112670] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.312712] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.312920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.313244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.313355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.313540] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.313675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.313745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.313935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.314056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.314203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.314342] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.616300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.616720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.616720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.617149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.617149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.617386] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1155.654783] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.655532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.659956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.659956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.659956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.673559] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1155.724639] env[69274]: INFO networking_nsxv3.common.synchronization [req-b4a0d5cb-a92f-447d-99a5-a7fe1cfa2680 req-b293e35e-3fa3-4f9f-8828-d5ddb7c708dc service nova] Enqueued Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_rules [ 1155.724639] env[69274]: INFO networking_nsxv3.common.synchronization [req-b4a0d5cb-a92f-447d-99a5-a7fe1cfa2680 req-b293e35e-3fa3-4f9f-8828-d5ddb7c708dc service nova] Enqueued Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_members [ 1155.724639] env[69274]: INFO networking_nsxv3.common.synchronization [req-b4a0d5cb-a92f-447d-99a5-a7fe1cfa2680 req-b293e35e-3fa3-4f9f-8828-d5ddb7c708dc service nova] Enqueued Resource ID: 234b7d55-418e-4712-ad4a-88d99af22471 with Priority: HIGHEST for action port [ 1155.725054] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_rules [ 1155.725054] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_members [ 1155.725054] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 234b7d55-418e-4712-ad4a-88d99af22471 with Priority: HIGHEST for action port [ 1155.725975] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.725975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.725975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.726219] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.726219] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.727840] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.727965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.728167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.732037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.732037] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.732037] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-234b7d55-418e-4712-ad4a-88d99af22471 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.732037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.732037] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('234b7d55-418e-4712-ad4a-88d99af22471',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.772889] env[69274]: INFO networking_nsxv3.common.synchronization [None req-10389da0-d763-4bc2-8d17-366528cb55f5 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1155.773595] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1155.774067] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.774545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.774545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.774856] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.774990] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.817149] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.817479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.817479] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.817783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.817846] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.817929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.818016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.818176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.818315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.818515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.818613] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.818725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.818784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.818934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.819092] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.819189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.819250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.819390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.819791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.819791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.819791] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.859725] env[69274]: INFO networking_nsxv3.common.synchronization [None req-b0671891-7943-448d-b670-39a7d5d870b3 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1155.860269] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1155.860952] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.861314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.229577] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.230099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.231659] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.234477] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 234b7d55-418e-4712-ad4a-88d99af22471 with status ACTIVE [ 1156.234664] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.234810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.234872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.235102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.235291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.235420] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.235559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.235620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.235901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.235901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.236065] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.236167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.236224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.236344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.236403] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.236540] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 234b7d55-418e-4712-ad4a-88d99af22471 is going to be updated. [ 1156.270059] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.270282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.270383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.270693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.270884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.271131] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-234b7d55-418e-4712-ad4a-88d99af22471" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.318639] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.318810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.318885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.319200] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.319298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.319404] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 already deleted. [ 1156.319491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.319672] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.319902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.319936] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.321882] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2339818-d892-4139-9105-430d1c6dde2e: rpc.has_security_group_logging(os_id): False [ 1156.348950] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.349168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.349235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.349628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.349628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.349829] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.349949] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.349997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.350354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.350354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.354033] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.354033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.354033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.354033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.354033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.354558] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.354816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.354933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.355211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.355385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.355538] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be updated. [ 1156.468779] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.468958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.469045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.469258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.470265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.484700] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 2s [ 1156.551259] env[69274]: INFO networking_nsxv3.common.synchronization [None req-ff215abc-fc2d-4da3-a3e1-8fac5bfb071e None None] Enqueued Resource ID: 3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18 with Priority: HIGHEST for action port [ 1156.551259] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18 with Priority: HIGHEST for action port [ 1156.551777] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.551933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.552019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.552450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.552543] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.598218] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1156.598488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.742106] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.847207] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.847207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.847207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.847207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.847207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.847207] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 already deleted. [ 1156.847207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.057330] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18 [ 1157.057626] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.057774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.057850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.058095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.058196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.058290] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18 already deleted. [ 1157.058371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b6a5ec9-12d5-4d8e-91cd-e716a3f59f18" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.245257] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.245257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.245257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.245599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.245599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.245752] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42671b00-adb1-46b6-9948-92a484306fcc is going to be created. [ 1157.282653] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.282810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.282876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.283758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.284135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.301828] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42671b00-adb1-46b6-9948-92a484306fcc in Status: UNINITIALIZED for 2s [ 1157.685215] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1157.685215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.685215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.685215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.686158] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.686158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.686158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.686390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.686967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.686967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.686967] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.189416] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.189758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.189758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.189930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.190060] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.190168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.190270] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.190386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.190472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.190570] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.190719] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.190814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.190869] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.191032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.193845] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.193845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.193845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.193845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.193845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.193845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.193845] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.498862] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1158.499140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.694417] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb1c245e-fab2-4558-9acb-1f5c9442e963: rpc.has_security_group_logging(os_id): False [ 1158.714883] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.714883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.714883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.714883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.714883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.714883] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.714883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.715345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.715345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.715345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.715426] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.715641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.715755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.715885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.715966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.716164] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.716266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.716329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.716527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.716614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.716711] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1158.784302] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.784302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.784302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.784539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.784678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.805704] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1159.324102] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42671b00-adb1-46b6-9948-92a484306fcc in Status: SUCCESS [ 1159.324418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.324637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.324960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.325326] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.325517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.325626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.325880] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.326017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.326175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.326339] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.833391] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.114625] env[69274]: INFO networking_nsxv3.common.synchronization [req-6ea733c7-5ba5-417e-8016-8f7a6af4808b req-03c66747-eaaa-4b48-aaab-0901ea0af5d2 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1160.116473] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1160.119355] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.119628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.119825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.120224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.120571] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.120781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.120939] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.121286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.121487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.121667] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.335834] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42671b00-adb1-46b6-9948-92a484306fcc: rpc.has_security_group_logging(os_id): False [ 1160.355277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.355469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.356195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.356195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.356195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.356195] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.356574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.356574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.356574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.356574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.356760] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42671b00-adb1-46b6-9948-92a484306fcc is going to be created. [ 1160.429676] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.429877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.430058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.430341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.430573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.443460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42671b00-adb1-46b6-9948-92a484306fcc in Status: IN_PROGRESS for 2s [ 1160.624993] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.625316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.625431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.625656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.625776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.625961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.626083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.626146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.626708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.626708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.626708] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1160.658018] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.658215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.658272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.658497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.658650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.667195] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1160.824070] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1160.824070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.318517] env[69274]: INFO networking_nsxv3.common.synchronization [req-81fa81dd-7ebb-4769-885e-a1395f4edafc req-740f784f-70c6-4052-9c4b-6bc8c9657e52 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1162.318848] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1162.319126] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.319294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.319387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.319681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.319907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.320053] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.320150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.320394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.320531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.320697] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.456656] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42671b00-adb1-46b6-9948-92a484306fcc in Status: SUCCESS [ 1162.456932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.633589] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.633795] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.633930] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.634335] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.634629] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.634810] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.634938] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.635187] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.635367] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.635626] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.635756] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.635919] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.635999] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.636128] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.636240] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.636378] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.655663] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.656504] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1162.656773] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.657351] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.657351] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-2c4f8192-5553-4771-a502-0c2ddae4ca4b taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.657578] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.657684] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.658038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.658189] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c4f8192-5553-4771-a502-0c2ddae4ca4b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.676994] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1162.677258] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1162.677418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.823384] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.823643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.823751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.824016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.824151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.824468] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.824568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.824636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.824797] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.824878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.824995] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 already deleted. [ 1162.825100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.160768] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.161041] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.161186] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.161403] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.161564] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.161728] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 2c4f8192-5553-4771-a502-0c2ddae4ca4b not found, creating... [ 1163.162017] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.162345] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.162528] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.162743] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.162952] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.163280] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.163441] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.163626] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.163849] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.163991] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.164155] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 2c4f8192-5553-4771-a502-0c2ddae4ca4b is going to be created. [ 1163.186038] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.186304] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.186474] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.186834] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.187414] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.187530] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.077088] env[69274]: INFO networking_nsxv3.common.synchronization [req-81fa81dd-7ebb-4769-885e-a1395f4edafc req-73704195-38d1-4b25-902c-58a540ebd313 service nova] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1164.077411] env[69274]: INFO networking_nsxv3.common.synchronization [req-81fa81dd-7ebb-4769-885e-a1395f4edafc req-73704195-38d1-4b25-902c-58a540ebd313 service nova] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1164.077497] env[69274]: INFO networking_nsxv3.common.synchronization [req-81fa81dd-7ebb-4769-885e-a1395f4edafc req-73704195-38d1-4b25-902c-58a540ebd313 service nova] Enqueued Resource ID: 2c4f8192-5553-4771-a502-0c2ddae4ca4b with Priority: HIGHEST for action port [ 1164.077838] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1164.077980] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1164.078110] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c4f8192-5553-4771-a502-0c2ddae4ca4b with Priority: HIGHEST for action port [ 1164.079366] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.079516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.079606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.079795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.079881] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.080749] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.080853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.080928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.081135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.081400] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.081517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.081600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.081828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.081956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.082070] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.082897] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c4f8192-5553-4771-a502-0c2ddae4ca4b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.083016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.083113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.083273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.083352] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c4f8192-5553-4771-a502-0c2ddae4ca4b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.585122] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.585379] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.585661] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.586660] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c4f8192-5553-4771-a502-0c2ddae4ca4b with status ACTIVE [ 1164.587511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.587511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.587511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.587511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.587511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.587786] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.587786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.587866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.588019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.588109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.588303] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.588409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.588474] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.588614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.588696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.588785] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c4f8192-5553-4771-a502-0c2ddae4ca4b is going to be updated. [ 1164.617991] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.618176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.618258] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.618460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.618602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.618808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c4f8192-5553-4771-a502-0c2ddae4ca4b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.090744] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.585534] env[69274]: INFO networking_nsxv3.common.synchronization [req-5e1fadac-c682-4a7f-8fbb-c4cd72a09d6d req-acaade6c-6ee6-4d7c-8d0f-c323f51866ac tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1165.586150] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1165.586511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.586656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.586728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.586969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.587694] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.587694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.587694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.589585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.589585] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.589585] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.593137] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.593273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.593349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.593549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.593637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.595035] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be created. [ 1165.625560] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.625719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.625795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.626010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.626181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.639881] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: UNINITIALIZED for 2s [ 1165.923169] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-738 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.923405] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.923539] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.923854] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.924355] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.924597] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.924767] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.925133] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.925350] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.926035] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.926035] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.926035] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.926035] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.926219] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.926286] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.926503] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.946430] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.947171] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.947171] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.947171] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-738" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.947514] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.947736] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.947949] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.948303] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.948498] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d35fd9-fe26-4f2b-8124-c47eb74ac181',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.090292] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.451600] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.451938] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.452038] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.452354] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.452518] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.452685] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port b4d35fd9-fe26-4f2b-8124-c47eb74ac181 not found, creating... [ 1166.452970] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.453163] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.453286] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.453540] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.453682] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.453977] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.454991] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.455142] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.455443] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.455774] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.455943] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: b4d35fd9-fe26-4f2b-8124-c47eb74ac181 is going to be created. [ 1166.478583] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.478890] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.478983] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.479320] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.479655] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.479977] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.592381] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.096483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.096782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.096782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.096976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.097100] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.097207] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be updated. [ 1167.165824] env[69274]: INFO networking_nsxv3.common.synchronization [req-5e1fadac-c682-4a7f-8fbb-c4cd72a09d6d req-d426b21a-9c0e-4d26-b8ad-7e8756e71129 service nova] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 1167.166038] env[69274]: INFO networking_nsxv3.common.synchronization [req-5e1fadac-c682-4a7f-8fbb-c4cd72a09d6d req-d426b21a-9c0e-4d26-b8ad-7e8756e71129 service nova] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1167.166197] env[69274]: INFO networking_nsxv3.common.synchronization [req-5e1fadac-c682-4a7f-8fbb-c4cd72a09d6d req-d426b21a-9c0e-4d26-b8ad-7e8756e71129 service nova] Enqueued Resource ID: b4d35fd9-fe26-4f2b-8124-c47eb74ac181 with Priority: HIGHEST for action port [ 1167.166764] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_rules [ 1167.166930] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1167.170848] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d35fd9-fe26-4f2b-8124-c47eb74ac181 with Priority: HIGHEST for action port [ 1167.174046] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.174046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.174046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.174046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.174046] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.175406] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.175406] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.176023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.176165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.176496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.176761] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.176851] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d35fd9-fe26-4f2b-8124-c47eb74ac181',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.198076] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.198076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.198076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.198076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.198076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.213286] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: IN_PROGRESS for 2s [ 1167.650952] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1167.651256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.651443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.651759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.651934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.652068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.652136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.652309] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.652427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.652521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.652619] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.675834] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.675834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.684023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4d35fd9-fe26-4f2b-8124-c47eb74ac181 with status ACTIVE [ 1167.684023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.684023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.684023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.684023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.684023] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4d35fd9-fe26-4f2b-8124-c47eb74ac181 is going to be updated. [ 1167.707361] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.707532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.707590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.707855] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.707999] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.708183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d35fd9-fe26-4f2b-8124-c47eb74ac181" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.159686] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.663697] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8653ee19-c57a-46f8-93e1-b1877cf8c937: rpc.has_security_group_logging(os_id): False [ 1168.696064] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.696064] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.696064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.696064] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be created. [ 1168.758850] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.758850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.758850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.758850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.758850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.772446] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1169.224113] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: SUCCESS [ 1169.224113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.224113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.224113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.224113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.224113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.224113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.224113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.224113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.224113] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.726817] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.229479] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.732961] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.733371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.733371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.733450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.733552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.733657] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be updated. [ 1170.769268] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.769513] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.769641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.769953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.770208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.781816] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: IN_PROGRESS for 2s [ 1170.782790] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1170.783018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.404720] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.404974] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.405116] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.405455] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.405775] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.405986] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.406125] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.406353] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.406534] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.406762] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.406886] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.407010] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.407140] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.407260] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.407374] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.407541] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.427105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.427384] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1171.427575] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.427811] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-987" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.428170] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fe561928-8b58-4b50-9b19-9469ae406eb2 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.428414] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.428564] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.428906] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.429073] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe561928-8b58-4b50-9b19-9469ae406eb2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.931307] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.931674] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.931726] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.931972] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.932148] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.933112] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.933317] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.933448] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.933698] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.933829] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.934148] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.934358] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.934579] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.934762] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.934919] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.935087] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fe561928-8b58-4b50-9b19-9469ae406eb2 is going to be updated. [ 1171.958515] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.958766] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.958910] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.959601] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.959601] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.959740] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.172402] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1172.172402] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1172.659170] env[69274]: INFO networking_nsxv3.common.synchronization [req-f12963dc-e61f-4d18-aef5-6e98ad1b5834 req-9036e904-541c-49df-ab3c-0f4d7e887641 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1172.659170] env[69274]: INFO networking_nsxv3.common.synchronization [req-f12963dc-e61f-4d18-aef5-6e98ad1b5834 req-9036e904-541c-49df-ab3c-0f4d7e887641 service nova] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1172.659170] env[69274]: INFO networking_nsxv3.common.synchronization [req-f12963dc-e61f-4d18-aef5-6e98ad1b5834 req-9036e904-541c-49df-ab3c-0f4d7e887641 service nova] Enqueued Resource ID: fe561928-8b58-4b50-9b19-9469ae406eb2 with Priority: HIGHEST for action port [ 1172.659170] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_rules [ 1172.659170] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1172.659170] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe561928-8b58-4b50-9b19-9469ae406eb2 with Priority: HIGHEST for action port [ 1172.659170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.659170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.659170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.659170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.659170] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.659170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.659170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.659170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.659170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.659170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.660164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.660164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.660164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.660164] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.660164] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.660538] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe561928-8b58-4b50-9b19-9469ae406eb2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.660538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.660538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.660719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.660719] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe561928-8b58-4b50-9b19-9469ae406eb2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.793194] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: SUCCESS [ 1172.793559] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.793831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.794154] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.794464] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.794651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.794778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.795095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.795203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.795365] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.795535] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.163068] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.163481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.163481] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.164478] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe561928-8b58-4b50-9b19-9469ae406eb2 with status ACTIVE [ 1173.165318] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.165318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.165318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.165318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.165318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.165630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.165630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.165630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.165755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.165791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.165976] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.166093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.166156] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.166307] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.166389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.166526] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe561928-8b58-4b50-9b19-9469ae406eb2 is going to be updated. [ 1173.187592] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.187804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.187804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.188032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.188222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.188404] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe561928-8b58-4b50-9b19-9469ae406eb2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.298648] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.668491] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.801157] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 833fffe2-1aa6-4f10-9ea0-4e315ed92177: rpc.has_security_group_logging(os_id): False [ 1173.821775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.822033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.822033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.822374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.842391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.842743] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.842969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.843041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.843282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.843405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.843535] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be updated. [ 1173.929485] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.929772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.929772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.930152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.930373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.942691] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: IN_PROGRESS for 2s [ 1174.175215] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.175671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.175671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.175775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.175775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.175890] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1174.205591] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.205785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.205859] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.206092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.206240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.218426] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1174.322453] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2327755-a614-4918-91d1-decd45bc0b5e req-06a1fa38-1c66-4d62-b0a4-4c44d7358175 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1174.322573] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1174.322862] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.323015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.323092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.323352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.323522] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.323631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.323714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.323908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.323993] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.324141] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.830289] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.830489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.830534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.830802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.830922] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.831178] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.831316] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.831393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.831589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.831694] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.831835] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1174.864511] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.864689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.864771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.865043] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.865196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.876501] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1174.912028] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.912028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.912028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.912028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.912028] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.912028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.912028] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.912628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.912628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.912876] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.912960] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.913041] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.913174] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.913309] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.913437] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.913579] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.940594] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.940819] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1174.940995] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.941224] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-716" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.941611] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-70bd7b30-4d88-4d49-945e-2416742ddd6c taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.941822] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.941977] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.942747] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.942843] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70bd7b30-4d88-4d49-945e-2416742ddd6c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.448062] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.448616] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.448691] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.448977] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.449226] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.449404] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 70bd7b30-4d88-4d49-945e-2416742ddd6c not found, creating... [ 1175.449900] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.449900] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.450100] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.450262] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.451757] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.452160] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.452636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.452636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.453303] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.453512] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.454203] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 70bd7b30-4d88-4d49-945e-2416742ddd6c is going to be created. [ 1175.480536] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.480536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.480536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.480536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.480536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.480536] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.957282] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: SUCCESS [ 1175.957527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.228934] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1176.229208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.229445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.229714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.229953] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.230110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.230202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.230397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.230495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.230768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.230768] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.242228] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2327755-a614-4918-91d1-decd45bc0b5e req-95868edd-84ad-4268-84b2-34e2e9c88a3a service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1176.242539] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2327755-a614-4918-91d1-decd45bc0b5e req-95868edd-84ad-4268-84b2-34e2e9c88a3a service nova] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1176.242715] env[69274]: INFO networking_nsxv3.common.synchronization [req-f2327755-a614-4918-91d1-decd45bc0b5e req-95868edd-84ad-4268-84b2-34e2e9c88a3a service nova] Enqueued Resource ID: 70bd7b30-4d88-4d49-945e-2416742ddd6c with Priority: HIGHEST for action port [ 1176.243572] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_rules [ 1176.243722] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1176.243827] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70bd7b30-4d88-4d49-945e-2416742ddd6c with Priority: HIGHEST for action port [ 1176.244466] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.244596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.244667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.244884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.244970] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.245870] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.245976] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.249658] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-70bd7b30-4d88-4d49-945e-2416742ddd6c taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.249658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.249658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.249658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.249658] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70bd7b30-4d88-4d49-945e-2416742ddd6c',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.394477] env[69274]: INFO networking_nsxv3.common.synchronization [req-f325eca7-502b-4357-b8f7-97db386c1ebe req-df8c53cb-2c94-4e2c-9602-e2f8550b2457 tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_members [ 1176.395099] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGHEST for action security_group_members [ 1176.395456] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.395581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.395637] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.395837] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.395990] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.396119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.396196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.396310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.396405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.396479] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.733663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.734119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.734119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.734223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.734460] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.734583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.734646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.734845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.734955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.735074] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.735258] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.735380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.735463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.735658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.735828] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.736487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.736487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.736487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.736487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.736487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.736487] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.748792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.749031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.752437] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70bd7b30-4d88-4d49-945e-2416742ddd6c with status ACTIVE [ 1176.752645] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.752820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.752913] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.753151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.753267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.753486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.753614] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.753689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.753865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.753964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.754198] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.754294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.754415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.754557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.754641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.754759] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70bd7b30-4d88-4d49-945e-2416742ddd6c is going to be updated. [ 1176.789690] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.789943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.789943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.790656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.790656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.790656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70bd7b30-4d88-4d49-945e-2416742ddd6c" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.888878] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1176.889109] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1176.889405] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.889886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.890176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.890441] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.890725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.890725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.890914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.891094] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.891271] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.899098] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.899462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.899462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.899955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.899955] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.900144] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.900144] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.900266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.900627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.900627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.900627] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 is going to be updated. [ 1176.946674] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.946858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.946942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.947203] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.947394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.959961] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: IN_PROGRESS for 2s [ 1177.238644] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb1c245e-fab2-4558-9acb-1f5c9442e963: rpc.has_security_group_logging(os_id): False [ 1177.263375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.263613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.263613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.263873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.263873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.264105] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.264232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.264296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.264509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.264590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.264792] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.264897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.264947] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.265087] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.265223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.265401] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.265508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.265508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.265664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.265744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.265814] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1177.350548] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.350548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.350548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.350548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.350548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.372681] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1177.396938] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.898422] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.402742] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.402742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.402742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.402742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.402742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.402742] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1178.438866] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.438866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.438866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.438866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.438866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.446898] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1178.973791] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 in Status: SUCCESS [ 1178.974287] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 deletion is rescheduled due to dependency. [ 1178.974287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.397255] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1179.397255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.458012] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1180.458535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.458791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.459095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.459368] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.459567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.459654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.459917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.460081] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.460247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.460430] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.963222] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.963431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.963431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.963640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.963818] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.963926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.963991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.964161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.964252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.964342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.964549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.964647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.964712] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.964853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.964992] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.965099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.965163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.965305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.965384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.965467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.965556] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.322532] env[69274]: INFO networking_nsxv3.common.synchronization [None req-518d6b50-1a0d-4040-bc63-0328a37e9bac tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_rules [ 1181.323176] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_rules [ 1181.323510] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.323667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.323745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.324013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.324101] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.393245] env[69274]: INFO networking_nsxv3.common.synchronization [None req-49a0b176-f7e4-4f42-a2fe-251089028d72 tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_rules [ 1181.393584] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_rules [ 1181.393883] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.393982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.469951] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf62572c-aed8-4405-8e2e-513d1f9f3976: rpc.has_security_group_logging(os_id): False [ 1181.488843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.488843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.488843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.488843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.489457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.489457] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.489457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.489457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.489457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.489457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.489628] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1181.554273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.554478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.554524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.554784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.555027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.572349] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1181.844483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.844656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.844717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.845015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.845150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.845253] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e already deleted. [ 1181.845344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.845569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.845726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.845811] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.372795] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.373037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.373671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.373671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.373671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.373671] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e already deleted. [ 1182.373671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.406972] env[69274]: INFO networking_nsxv3.common.synchronization [None req-ceacf720-87d2-4011-96c6-766e3cccb09d tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_rules [ 1182.409233] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_rules [ 1182.409233] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.409233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.409233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.409233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.409233] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.527542] env[69274]: INFO networking_nsxv3.common.synchronization [None req-ea51fcb9-7eae-4d05-9c12-3206c74c768f tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_rules [ 1182.528090] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_rules [ 1182.528550] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.528717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.932446] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.932685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.932842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.933230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.933318] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.933517] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac already deleted. [ 1182.933653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.933923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.934080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.934334] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.456041] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.456041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.456041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.456395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.456395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.456395] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac already deleted. [ 1183.456510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.594105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1183.594511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.190451] env[69274]: INFO networking_nsxv3.common.synchronization [req-d4bb84ca-2509-466c-a3a6-5e91e98407c9 req-7aaba089-8adb-4613-a127-452ccd24461f tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_members [ 1187.191016] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_members [ 1187.191329] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.191454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.191544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.191804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.191963] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.195411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.195411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.195411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.195411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.195411] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.504023] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.504023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.504023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.504023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.504023] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.504023] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.504879] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.505242] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.505535] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.505881] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.506120] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.506336] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.506541] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.506799] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.507085] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.507331] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.531713] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.531713] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.531713] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.531713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-383" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.531713] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.531713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.531713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.531713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.531713] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb69aeb1-9486-4aa0-8333-9261d14aa9fc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.696932] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.696932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.696932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.697233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.697233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.697487] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.697487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.697487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.697627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.697700] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.697957] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e already deleted. [ 1187.697957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.034582] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.034861] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.034999] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.035586] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.035586] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.035718] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port fb69aeb1-9486-4aa0-8333-9261d14aa9fc not found, creating... [ 1188.036103] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.036290] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.036477] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.036763] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.036917] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.037253] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.037426] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.037556] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.037788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.037933] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.038102] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fb69aeb1-9486-4aa0-8333-9261d14aa9fc is going to be created. [ 1188.061185] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.061429] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.061540] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.061836] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.062105] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.062389] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.796181] env[69274]: INFO networking_nsxv3.common.synchronization [req-d4bb84ca-2509-466c-a3a6-5e91e98407c9 req-b3c06098-d95a-4941-b459-8e3ddc8fabb5 service nova] Enqueued Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_rules [ 1188.796181] env[69274]: INFO networking_nsxv3.common.synchronization [req-d4bb84ca-2509-466c-a3a6-5e91e98407c9 req-b3c06098-d95a-4941-b459-8e3ddc8fabb5 service nova] Enqueued Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_members [ 1188.796181] env[69274]: INFO networking_nsxv3.common.synchronization [req-d4bb84ca-2509-466c-a3a6-5e91e98407c9 req-b3c06098-d95a-4941-b459-8e3ddc8fabb5 service nova] Enqueued Resource ID: fb69aeb1-9486-4aa0-8333-9261d14aa9fc with Priority: HIGHEST for action port [ 1188.796181] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_rules [ 1188.797302] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_members [ 1188.797302] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb69aeb1-9486-4aa0-8333-9261d14aa9fc with Priority: HIGHEST for action port [ 1188.797517] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.797517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.797610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.797870] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.797958] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.800021] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.800267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.800341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.800541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.800716] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.800823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.800884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.801060] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.801179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.801277] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.802133] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.802941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.802941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.802941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.802941] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb69aeb1-9486-4aa0-8333-9261d14aa9fc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.304770] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.308835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.308835] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb69aeb1-9486-4aa0-8333-9261d14aa9fc with status ACTIVE [ 1189.308835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.308835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.308835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.308835] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.309751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.309751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.309751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.309751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.309751] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb69aeb1-9486-4aa0-8333-9261d14aa9fc is going to be updated. [ 1189.334657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.334911] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.335013] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.335242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.335388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.335563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb69aeb1-9486-4aa0-8333-9261d14aa9fc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.642513] env[69274]: INFO networking_nsxv3.common.synchronization [req-d9ccd8f1-615c-4340-bb90-5717a39b5a31 req-2398182b-6b69-4036-908e-92ea4446d051 tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_members [ 1189.643119] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_members [ 1189.643467] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.643605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.643669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.643917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.644293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.644293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.644293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.644625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.644625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.644625] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.679429] env[69274]: INFO networking_nsxv3.common.synchronization [req-a689c63c-dc24-41ee-85c9-8ab953f0d2d8 req-d6460ecb-f4fb-429a-a025-9ac7fad8773b tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1189.679797] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1189.680118] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.680237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.680306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.680506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.680657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.681241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.681241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.681241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.681241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.681241] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.810478] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.149916] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.150098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.150195] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.150386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.150480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.150689] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.150787] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.150843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.150988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.151078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.151167] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac already deleted. [ 1190.151252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.184350] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.263089] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.263302] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.263435] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.263788] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.264539] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.264829] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.264906] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.265144] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.265300] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.265535] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.266067] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.266209] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.266332] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.266458] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.266636] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.266854] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.286562] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.286562] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.286562] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.286774] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-139" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.287065] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.287265] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.287397] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.287737] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.287887] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.315244] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.315244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.315244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.315244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.315244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.315244] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e is going to be created. [ 1190.340814] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.341039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.341039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.341250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.341421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.352477] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e in Status: UNINITIALIZED for 2s [ 1190.687174] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.791277] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.791491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.791640] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.791964] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.792178] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.792374] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a not found, creating... [ 1190.792715] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.792909] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.793050] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.793304] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.793456] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.793810] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.794008] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.794147] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.794369] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.794559] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.794715] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a is going to be created. [ 1190.816865] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.817274] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.817460] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.817769] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.818155] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.818519] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.189664] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.189920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.190073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.190329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.190458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.190606] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 is going to be updated. [ 1191.230914] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.231230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.231426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.231595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.231752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.253304] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: IN_PROGRESS for 2s [ 1191.530849] env[69274]: INFO networking_nsxv3.common.synchronization [req-d9ccd8f1-615c-4340-bb90-5717a39b5a31 req-7badadb8-048b-41b7-a7ee-2bbe5043729d service nova] Enqueued Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_rules [ 1191.531055] env[69274]: INFO networking_nsxv3.common.synchronization [req-d9ccd8f1-615c-4340-bb90-5717a39b5a31 req-7badadb8-048b-41b7-a7ee-2bbe5043729d service nova] Enqueued Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_members [ 1191.531204] env[69274]: INFO networking_nsxv3.common.synchronization [req-d9ccd8f1-615c-4340-bb90-5717a39b5a31 req-7badadb8-048b-41b7-a7ee-2bbe5043729d service nova] Enqueued Resource ID: a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a with Priority: HIGHEST for action port [ 1191.531446] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_rules [ 1191.531601] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_members [ 1191.531717] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a with Priority: HIGHEST for action port [ 1191.532331] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.532665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.532801] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.532974] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.533078] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.533950] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.534165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.534165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.534346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.534638] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.534775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.534847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.535021] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.535110] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.535206] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.536138] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.536285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.536335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.536461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.536540] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.038528] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.038824] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.040036] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.041272] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a with status ACTIVE [ 1192.041466] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.041587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.041657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.041888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.042091] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.042238] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.042238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.042355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.042473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.042581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.042781] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.042832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.042888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.043057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.043157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.043246] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a is going to be updated. [ 1192.067885] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.067885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.067885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.068119] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.068220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.068387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a73c91c6-f5cb-4e64-bc17-d56d3c7dd23a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.365854] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e in Status: SUCCESS [ 1192.365854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.365854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.365854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.365854] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.365854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.365854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.365854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.366296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.368072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.368072] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.546848] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.870215] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.050272] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.050583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.050583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.050731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.050838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.051437] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac is going to be created. [ 1193.075417] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.075635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.075719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.075953] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.076158] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.086996] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac in Status: UNINITIALIZED for 2s [ 1193.264335] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: SUCCESS [ 1193.264335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.372134] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e: rpc.has_security_group_logging(os_id): False [ 1193.390883] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.391093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.391143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.391380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.391482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.391735] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.391838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.391907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.392078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.392159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.392246] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e is going to be created. [ 1193.456474] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.456690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.456690] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.456905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.457104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.467570] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e in Status: IN_PROGRESS for 2s [ 1195.098017] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac in Status: SUCCESS [ 1195.098272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.098272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.098533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.098697] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.099051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.099099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.099799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.099799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.099799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.099799] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.485372] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e in Status: SUCCESS [ 1195.485653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.601948] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.016964] env[69274]: INFO networking_nsxv3.common.synchronization [req-6d18a6f9-141a-4987-acde-7941fd745bb9 req-e1dc0a3e-c484-4c0f-a5ee-7b659866a0d3 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1196.017536] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93500972-b84b-40e5-abe8-7eeafad09413 with Priority: HIGHEST for action security_group_members [ 1196.017852] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-93500972-b84b-40e5-abe8-7eeafad09413 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.017981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.018066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.018267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.018417] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.018517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.018582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.018727] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.019473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.019473] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93500972-b84b-40e5-abe8-7eeafad09413',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.103913] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08640a4a-b7e4-4d8a-81e0-f0c8623136ac: rpc.has_security_group_logging(os_id): False [ 1196.128013] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.128254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.128254] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.128491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.128592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.128923] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.129022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.129098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.129288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.129340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.129451] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac is going to be created. [ 1196.200863] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.200863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.200863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.200863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.201169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.213919] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac in Status: IN_PROGRESS for 2s [ 1196.521277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.521277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.521277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.521643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.521643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.522418] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.522418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.522418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.522418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.523041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.523041] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 is going to be updated. [ 1196.559177] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.559536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.559536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.559786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.559786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.573196] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: IN_PROGRESS for 2s [ 1198.237329] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac in Status: SUCCESS [ 1198.237722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.583443] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93500972-b84b-40e5-abe8-7eeafad09413 in Status: SUCCESS [ 1198.583624] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93500972-b84b-40e5-abe8-7eeafad09413 deletion is rescheduled due to dependency. [ 1198.583735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93500972-b84b-40e5-abe8-7eeafad09413" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.018868] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1201.019216] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1201.735309] env[69274]: INFO networking_nsxv3.common.synchronization [None req-cda039a0-4d26-435d-9328-883bdcd5b447 tempest-AttachInterfacesTestJSON-1053470827 tempest-AttachInterfacesTestJSON-1053470827-project-member] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1201.735859] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGHEST for action security_group_members [ 1201.738216] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.738216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.738216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.738216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.738216] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.738216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.738216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.738216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.738216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.738216] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.240123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.240569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.240569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.240569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.240862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.240862] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.241024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.241024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.241167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.241242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.241330] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be updated. [ 1202.284933] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.285182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.285182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.285359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.285500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.301040] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: IN_PROGRESS for 2s [ 1204.310433] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 in Status: SUCCESS [ 1204.310792] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 deletion is rescheduled due to dependency. [ 1204.310792] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.737420] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.737420] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1207.443871] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-20 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.444136] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.444259] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.444640] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.444887] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.445522] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.445703] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.445982] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.446160] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.446394] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.446531] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.446664] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.446783] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.446924] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.447103] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.447273] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.470460] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.470735] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.470815] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.470981] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-20" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.471425] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.471633] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.471796] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.472157] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.472356] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8ff0a0-a82b-4129-ae4b-9e03c7be3799',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.974846] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.975428] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.975428] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.975560] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.975719] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.976068] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.976255] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.976380] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.976635] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.976799] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.977124] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.977303] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.977429] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.977667] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.977812] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.977962] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 is going to be updated. [ 1208.002573] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.002811] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.002863] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.003171] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.003392] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.003675] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.869690] env[69274]: INFO networking_nsxv3.common.synchronization [req-45cb8d2a-98c0-456d-b9aa-00d5ee65f8db req-ac5f0f30-b15a-4cc2-a190-505ab1088177 service nova] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1208.869885] env[69274]: INFO networking_nsxv3.common.synchronization [req-45cb8d2a-98c0-456d-b9aa-00d5ee65f8db req-ac5f0f30-b15a-4cc2-a190-505ab1088177 service nova] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1208.870079] env[69274]: INFO networking_nsxv3.common.synchronization [req-45cb8d2a-98c0-456d-b9aa-00d5ee65f8db req-ac5f0f30-b15a-4cc2-a190-505ab1088177 service nova] Enqueued Resource ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 with Priority: HIGHEST for action port [ 1208.870329] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_rules [ 1208.870479] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1208.870609] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 with Priority: HIGHEST for action port [ 1208.871647] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.871799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.871866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.872800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.872912] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.874221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.874343] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.874415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.874630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.874785] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.874890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.874956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.878023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.878023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.878023] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.878023] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.878023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.878023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.878023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.878023] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8ff0a0-a82b-4129-ae4b-9e03c7be3799',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.382218] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.383486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.383611] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.383844] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 with status ACTIVE [ 1209.384044] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.384179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.384250] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.384482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.384790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.384834] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.384925] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.384988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.385204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.385327] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.385482] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.385612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.385681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.385831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.385910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.386021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e8ff0a0-a82b-4129-ae4b-9e03c7be3799 is going to be updated. [ 1209.409226] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.409384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.409460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.409647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.409789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.409960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e8ff0a0-a82b-4129-ae4b-9e03c7be3799" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.888261] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.390931] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.391352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.391352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.391780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.392017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.392235] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 is going to be updated. [ 1210.422249] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.422249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.422540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.422634] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.422818] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.434719] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: IN_PROGRESS for 2s [ 1212.446929] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: SUCCESS [ 1212.447325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.447441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.447699] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.447936] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.448111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.448202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.448384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.448489] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.448573] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.448668] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.951428] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.453306] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b037ccd-78b0-43be-acdd-bcc8531b52f5: rpc.has_security_group_logging(os_id): False [ 1213.473136] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.473287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.473361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.473664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.473790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.474112] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.474299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.474400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.474640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.474740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.474915] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 is going to be updated. [ 1213.540840] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.541103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.541103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.541368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.541544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.554444] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: IN_PROGRESS for 2s [ 1213.871516] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1213.871586] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1215.571019] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: SUCCESS [ 1215.571019] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.873217] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1218.873616] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1219.780439] env[69274]: INFO networking_nsxv3.common.synchronization [req-f7cfb18c-88fd-4f42-827e-d04177b2c88c req-9045553f-fef8-463a-9b4a-a5a39088fb66 tempest-DeleteServersTestJSON-1572083456 tempest-DeleteServersTestJSON-1572083456-project-member] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1219.781123] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGHEST for action security_group_members [ 1219.782342] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.783031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.783031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.783031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.783031] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.783259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.783259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.783336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.783742] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.783742] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.286486] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.286878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.286878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.286878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.287024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.287227] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.287337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.287401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.287569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.287651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.287739] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be updated. [ 1220.319679] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.319923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.319975] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.320196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.320345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.329377] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: IN_PROGRESS for 2s [ 1222.340351] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 in Status: SUCCESS [ 1222.340786] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 deletion is rescheduled due to dependency. [ 1222.340786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.568120] env[69274]: INFO networking_nsxv3.common.synchronization [req-c5e436db-ac1e-428c-ad68-f0b8a95f7e91 req-b4d0acf5-e0c7-45a4-8517-91b0ded60a7c tempest-AttachVolumeNegativeTest-1274872941 tempest-AttachVolumeNegativeTest-1274872941-project-member] Enqueued Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_members [ 1222.568729] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGHEST for action security_group_members [ 1222.569107] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.569238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.569361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.569503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.569663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.569762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.569828] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.569982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.570075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.570173] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.073562] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.073562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.073562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.073562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.073562] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.073877] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.073877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.073877] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.073998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.074079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.074170] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42671b00-adb1-46b6-9948-92a484306fcc is going to be updated. [ 1223.104026] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.104223] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.104284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.104461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.104605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.115214] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42671b00-adb1-46b6-9948-92a484306fcc in Status: IN_PROGRESS for 2s [ 1225.127079] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42671b00-adb1-46b6-9948-92a484306fcc in Status: SUCCESS [ 1225.127440] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42671b00-adb1-46b6-9948-92a484306fcc deletion is rescheduled due to dependency. [ 1225.127626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.335764] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-280 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.335999] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.336149] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.336422] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.336684] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.336850] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.336976] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.337385] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.337546] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.337789] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.337927] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1225.338072] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1225.338193] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1225.338346] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.338437] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1225.338580] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1225.359067] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1225.359263] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1225.359412] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1225.359605] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-280" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.359920] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d16b1e5b-3252-489f-830f-f66e5ae29d31 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.360118] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.360247] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.360521] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.360666] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16b1e5b-3252-489f-830f-f66e5ae29d31',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.863272] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.863582] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.863743] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.864026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.864188] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.864500] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.864671] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.864825] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.865081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.865231] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.865521] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.865693] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.865880] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.866216] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.866405] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.866617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 is going to be updated. [ 1225.891051] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.891357] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.891547] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.891903] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.892166] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.892438] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.620035] env[69274]: INFO networking_nsxv3.common.synchronization [req-1a126e69-7c8a-4cd6-b3cc-a477f86a4149 req-d0d85394-a502-4cd9-94c6-b33fab26fa4c service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 1226.620035] env[69274]: INFO networking_nsxv3.common.synchronization [req-1a126e69-7c8a-4cd6-b3cc-a477f86a4149 req-d0d85394-a502-4cd9-94c6-b33fab26fa4c service nova] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1226.620035] env[69274]: INFO networking_nsxv3.common.synchronization [req-1a126e69-7c8a-4cd6-b3cc-a477f86a4149 req-d0d85394-a502-4cd9-94c6-b33fab26fa4c service nova] Enqueued Resource ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 with Priority: HIGHEST for action port [ 1226.620035] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_rules [ 1226.620035] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1226.620035] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 with Priority: HIGHEST for action port [ 1226.620035] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.620035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.620867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.621029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.621113] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.622798] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.623956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.623956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.623956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.623956] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.623956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.623956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.623956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.623956] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.624297] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.624962] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d16b1e5b-3252-489f-830f-f66e5ae29d31 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.625823] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.625907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.626180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.626180] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16b1e5b-3252-489f-830f-f66e5ae29d31',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.128459] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.128686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.128803] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.132326] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d16b1e5b-3252-489f-830f-f66e5ae29d31 with status ACTIVE [ 1227.132521] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.132645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.132726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.132964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.133077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.135077] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.135077] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.135077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.135077] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d16b1e5b-3252-489f-830f-f66e5ae29d31 is going to be updated. [ 1227.157441] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.157593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.157667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.157926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.158022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.158181] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d16b1e5b-3252-489f-830f-f66e5ae29d31" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.630970] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.134302] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.134519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.134602] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.134898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.135028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.135105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1228.162838] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.162980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.163066] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.163276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.163422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.172800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1229.335548] env[69274]: INFO networking_nsxv3.common.synchronization [None req-cfa64d0e-c3df-46ae-a58f-9597ffc4480f None None] Enqueued Resource ID: a987bea3-5c30-4c9a-8c88-236951497b1b with Priority: HIGHEST for action port [ 1229.336138] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a987bea3-5c30-4c9a-8c88-236951497b1b with Priority: HIGHEST for action port [ 1229.336534] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a987bea3-5c30-4c9a-8c88-236951497b1b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.336665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a987bea3-5c30-4c9a-8c88-236951497b1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.336731] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a987bea3-5c30-4c9a-8c88-236951497b1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.337228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a987bea3-5c30-4c9a-8c88-236951497b1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.337348] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a987bea3-5c30-4c9a-8c88-236951497b1b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.840243] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a987bea3-5c30-4c9a-8c88-236951497b1b [ 1229.840791] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.840791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.840791] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.841052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.841170] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.841322] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a987bea3-5c30-4c9a-8c88-236951497b1b already deleted. [ 1229.841426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a987bea3-5c30-4c9a-8c88-236951497b1b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.183940] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1230.184281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.184885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.185180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.185396] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.185677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.185677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.185849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.185898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.186017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.186082] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.688175] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.190479] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15291f2b-281c-4bf0-a609-bcb369c82f51: rpc.has_security_group_logging(os_id): False [ 1231.207994] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.208359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.208359] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.208563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.208563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.208762] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.208860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.208938] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.209078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.209159] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.209247] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1231.285918] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.286259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.286259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.286486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.286543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.312714] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1231.510515] env[69274]: INFO networking_nsxv3.common.synchronization [None req-20b4370f-b0cc-4c31-b53f-c6d9d23e2162 None None] Enqueued Resource ID: b2c95c84-d0f3-4e8f-86dd-2e3074b24116 with Priority: HIGHEST for action port [ 1231.511207] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c95c84-d0f3-4e8f-86dd-2e3074b24116 with Priority: HIGHEST for action port [ 1231.511398] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2c95c84-d0f3-4e8f-86dd-2e3074b24116 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.511522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2c95c84-d0f3-4e8f-86dd-2e3074b24116" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.511574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2c95c84-d0f3-4e8f-86dd-2e3074b24116" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.511836] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2c95c84-d0f3-4e8f-86dd-2e3074b24116" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.511939] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c95c84-d0f3-4e8f-86dd-2e3074b24116',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.016154] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2c95c84-d0f3-4e8f-86dd-2e3074b24116 [ 1232.016595] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.016779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.016871] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.017167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.017264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.017428] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2c95c84-d0f3-4e8f-86dd-2e3074b24116 already deleted. [ 1232.017558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2c95c84-d0f3-4e8f-86dd-2e3074b24116" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.326773] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1233.327241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.787257] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-1e804eef-4478-4931-8bd9-4314304b4e7d tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1234.788501] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1234.788854] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.788988] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.789076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.789360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.789750] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.789873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.789946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.790134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.790230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.790329] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.117703] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.118016] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.118186] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.118537] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.118821] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.119052] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.119193] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.119440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.119594] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.119917] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.120067] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.120189] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.120306] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.120472] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.120523] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.120664] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.161134] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.161134] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.161134] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.161134] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.161464] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-d00adeaa-80ea-4e4f-880b-d669c7da0200 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.161551] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.161687] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.162034] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.162193] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00adeaa-80ea-4e4f-880b-d669c7da0200',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.292288] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.292456] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.292521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.292785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.292895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.293118] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.293226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.293283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.293466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.293544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.293634] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 already deleted. [ 1235.293719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.668177] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.668594] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.668776] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.669194] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.669670] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.669670] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port d00adeaa-80ea-4e4f-880b-d669c7da0200 not found, creating... [ 1235.669992] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.670182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.670376] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.670693] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.670928] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.671393] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.671636] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.671811] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.672106] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.672315] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.672511] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: d00adeaa-80ea-4e4f-880b-d669c7da0200 is going to be created. [ 1235.694708] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.695031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.695219] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.695546] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.695821] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.696143] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.413122] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-3115bf40-9e8c-4cdf-857d-d64f71d86fbe service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1236.413400] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-3115bf40-9e8c-4cdf-857d-d64f71d86fbe service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1236.413487] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-3115bf40-9e8c-4cdf-857d-d64f71d86fbe service nova] Enqueued Resource ID: d00adeaa-80ea-4e4f-880b-d669c7da0200 with Priority: HIGHEST for action port [ 1236.414013] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1236.414164] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1236.414268] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d00adeaa-80ea-4e4f-880b-d669c7da0200 with Priority: HIGHEST for action port [ 1236.414545] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.414671] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.414752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.417056] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.417228] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.419087] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.422989] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.422989] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.422989] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-d00adeaa-80ea-4e4f-880b-d669c7da0200 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.422989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.422989] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00adeaa-80ea-4e4f-880b-d669c7da0200',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.919712] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.919968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.924452] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.926081] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d00adeaa-80ea-4e4f-880b-d669c7da0200 with status ACTIVE [ 1236.926312] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.926539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.926660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.926900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.927008] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.930451] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.931319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.932446] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.932730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.932867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.933263] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.933375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.933432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.934418] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.935802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.935993] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d00adeaa-80ea-4e4f-880b-d669c7da0200 is going to be updated. [ 1236.965620] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.965909] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.966076] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.966467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.966733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.967472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d00adeaa-80ea-4e4f-880b-d669c7da0200" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.110787] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-95635a5f-b4ac-430a-a40b-d64a6580351c tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1237.111568] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1237.115027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.115027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.439114] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.547785] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.547785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.547785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.547785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.547785] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.547785] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.548951] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.551494] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.552042] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.552665] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1237.552961] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1237.555695] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1237.555695] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1237.555695] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1237.555695] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1237.555695] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1237.593764] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1237.594135] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1237.594391] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1237.594721] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.595312] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.595622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.595842] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.596410] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.596674] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3f67935-2ec0-4e3d-b733-2a42ee930fb0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.943639] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.943885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.943885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.944125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.944227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.944350] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be created. [ 1237.968484] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.968744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.968795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.969138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.969368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.980883] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: UNINITIALIZED for 2s [ 1238.103796] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.104041] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.104174] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.104491] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.104654] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.104880] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port c3f67935-2ec0-4e3d-b733-2a42ee930fb0 not found, creating... [ 1238.105143] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.105333] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.105470] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.105713] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.106031] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.106204] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.106372] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.106496] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.106721] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.106872] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.107110] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: c3f67935-2ec0-4e3d-b733-2a42ee930fb0 is going to be created. [ 1238.133032] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.133246] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.133414] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.133791] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.134081] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.134371] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.875293] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-d78f4f89-631e-49a7-b4ad-621f52751512 service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1238.875636] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-d78f4f89-631e-49a7-b4ad-621f52751512 service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1238.875947] env[69274]: INFO networking_nsxv3.common.synchronization [req-f146a80e-f12a-444f-96bc-074694c9ef7c req-d78f4f89-631e-49a7-b4ad-621f52751512 service nova] Enqueued Resource ID: c3f67935-2ec0-4e3d-b733-2a42ee930fb0 with Priority: HIGHEST for action port [ 1238.876793] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1238.877041] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1238.877238] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f67935-2ec0-4e3d-b733-2a42ee930fb0 with Priority: HIGHEST for action port [ 1238.877663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.877830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.878187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.878340] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.878659] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.878822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.878987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.879297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.879450] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3f67935-2ec0-4e3d-b733-2a42ee930fb0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.382432] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3f67935-2ec0-4e3d-b733-2a42ee930fb0 with status ACTIVE [ 1239.382726] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.382847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.382910] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.383189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.383306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.383462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.383568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.383631] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.383799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.383912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.384174] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.384282] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.384347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.384495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.384574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.384728] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3f67935-2ec0-4e3d-b733-2a42ee930fb0 is going to be updated. [ 1239.408408] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.408625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.408625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.408839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.408979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.409228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3f67935-2ec0-4e3d-b733-2a42ee930fb0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.992028] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1239.992028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.992028] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.992496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.992496] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.992496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.992616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.992706] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.992820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.992897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.993010] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.993886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.994070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.994230] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.994336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.994402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.994538] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.994626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.994701] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.496329] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.496467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.498892] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.001709] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.257767] env[69274]: INFO networking_nsxv3.common.synchronization [req-216d10d8-45af-4d18-ba45-7a132a7a130c req-801e78a8-87c8-4d4a-af76-a8a36f541eee tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1241.259059] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1241.259059] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.259059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.259059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.259885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.259885] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.259885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.259885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.260802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.260802] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.260802] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.505200] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.505484] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.505600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.505891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.506099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.506255] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1241.534390] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.535141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.535401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.535722] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.535986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.545716] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1241.762937] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.264761] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.769880] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.770103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.770103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.770296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.770391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.770496] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be updated. [ 1242.798101] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.798337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.798337] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.798526] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.799052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.808897] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: IN_PROGRESS for 2s [ 1243.559043] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1243.559553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.559553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.559650] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.559869] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.559989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.560057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.560313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.560452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.560595] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.063508] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.565523] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.820026] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: SUCCESS [ 1244.820026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.069409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.069645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.069645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.069856] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.069985] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.070131] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1245.101202] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.101361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.101436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.101653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.101806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.111970] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1245.571933] env[69274]: INFO networking_nsxv3.common.synchronization [req-a2eb367a-5ff3-4a30-85b0-5d1b975f249f req-a4bca33f-dcca-4f4e-ab1a-cab085a89246 tempest-ServerActionsTestOtherB-502014379 tempest-ServerActionsTestOtherB-502014379-project-member] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1245.572434] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGHEST for action security_group_members [ 1245.572778] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.572903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.572970] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.573190] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.573923] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.573923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.573923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.573923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.573923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.573923] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.076277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.076511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.076511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.076734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.076832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.077047] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.077157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.077244] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.077436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.077503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.077579] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be updated. [ 1246.111966] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.112226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.112226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.112434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.112583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.122593] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: IN_PROGRESS for 2s [ 1247.121288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1247.121661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.121760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.121982] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.122197] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.122320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.122388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.122547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.122632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.122719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.122912] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.123024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.123090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.123235] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.123374] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.123467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.123529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.123667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.123743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.123825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.123919] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.627370] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c85e3b3c-2e63-4ab4-8fe3-1ccaad491259: rpc.has_security_group_logging(os_id): False [ 1247.651202] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.651202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.651202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.651415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.651415] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.651593] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.651702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.651768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.651918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.652022] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.652535] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.652535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.652535] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.652717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.653213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.653213] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.653213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.653213] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.653543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.653543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.653543] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be created. [ 1247.724338] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.724501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.724656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.725427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.725427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.739543] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1248.134592] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 in Status: SUCCESS [ 1248.135105] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 deletion is rescheduled due to dependency. [ 1248.135105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.760105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1249.760491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.760599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.760820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.760932] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.263313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.263503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.263567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.263759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.263924] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.264037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.264106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.264259] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.264346] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.264434] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.264526] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.457079] env[69274]: INFO networking_nsxv3.common.synchronization [req-b229248e-73fa-4161-841a-5a1e793cc7d6 req-0b7bb556-ef9c-45d1-97cc-283a9f20c203 tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1250.457500] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1250.457770] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.457897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.457964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.459011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.459225] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.459370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.461736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.461736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.461736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.461736] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.536033] env[69274]: INFO networking_nsxv3.common.synchronization [req-c2087e98-9189-4f65-82e7-bba1d71a47f1 req-45375bdf-5b06-4579-81c1-44c2aff81357 tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1250.536171] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1250.536499] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.536632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.767282] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.767627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.962048] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.466259] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.968610] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.969038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.969038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.969120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.969226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.969342] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1251.997710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.997900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.997960] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.998189] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.998336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.006887] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1252.224485] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1252.224866] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:3 started [ 1254.019053] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1254.019445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.019445] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.019677] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.019919] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.020121] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.020222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.020424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.020537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.020665] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.525594] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.525807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.526045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.526330] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.526441] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.526654] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.526763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.526831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.527035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.527096] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.527198] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1254.558361] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.558361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.558361] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.558636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.558636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.574777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1255.536811] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.537112] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1256.585649] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1256.586147] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 deletion is rescheduled due to dependency. [ 1256.586147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.586233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.586426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.586624] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.586745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.586811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.586964] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.587136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.587204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.587346] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.587448] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.587509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.587656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.587794] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.587886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.587946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.588111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.588211] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.588287] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.588339] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.832362] env[69274]: INFO networking_nsxv3.common.synchronization [req-044d68ef-4ef4-4787-a1b0-769b0952586b req-6c59527b-996a-41c4-91c4-111c2c0575f8 tempest-ServerActionsTestOtherA-129038337 tempest-ServerActionsTestOtherA-129038337-project-member] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1256.832827] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGHEST for action security_group_members [ 1256.833153] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.833563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.833563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.833563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.833692] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.833763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.833838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.833983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.834086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.834199] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.090784] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c85e3b3c-2e63-4ab4-8fe3-1ccaad491259: rpc.has_security_group_logging(os_id): False [ 1257.108965] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.109207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.109207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.109407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.109501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.109698] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.109799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.109860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.110016] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.110106] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.110294] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.110396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.110458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.110605] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.110678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.110872] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.110969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.111046] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.111188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.111294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.111407] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1257.168436] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.168600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.168647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.168862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.169024] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.183882] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1257.336928] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.337286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.337286] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.337517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.337517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.337696] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.337794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.337866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.337991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.338099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.338172] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be updated. [ 1257.366054] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.366054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.366054] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.366263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.366402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.376021] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: IN_PROGRESS for 2s [ 1259.201092] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1259.201092] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.386094] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 in Status: SUCCESS [ 1259.386326] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 deletion is rescheduled due to dependency. [ 1259.386423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.032682] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-6ac90f68-7163-4602-86f0-ee6b988c1c35 tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1261.033176] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1261.033500] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.033627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.033701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.033903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.034107] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.034194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.034248] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.034400] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.034491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.034576] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.330101] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.330377] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.330486] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.330764] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.331151] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.331377] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.331508] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.331779] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.331968] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.332211] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.332335] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1261.332452] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1261.332568] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1261.332688] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.332801] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1261.332942] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1261.353422] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1261.353606] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1261.353769] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1261.353970] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.354359] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-4624546f-4991-4808-9acc-ede283d1b60f taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.354541] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.354690] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.355116] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.355297] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4624546f-4991-4808-9acc-ede283d1b60f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.537324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.537708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.537708] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.538088] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.538285] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.538639] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.538832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.539049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.539265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.539427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.539609] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1261.567192] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.567402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.567509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.567769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.567957] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.582468] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1261.857963] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.858266] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.858371] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.858679] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.858850] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.859055] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 4624546f-4991-4808-9acc-ede283d1b60f not found, creating... [ 1261.859338] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.859509] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.859637] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.859870] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.860035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.860404] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.860690] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.860832] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.861080] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.861236] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.861392] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 4624546f-4991-4808-9acc-ede283d1b60f is going to be created. [ 1261.883896] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.884127] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.884265] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.884551] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.884789] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.885112] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.568229] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-ccabc103-a62f-4a02-8ddf-469bed9fd3f8 service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1262.568524] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-ccabc103-a62f-4a02-8ddf-469bed9fd3f8 service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1262.568682] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-ccabc103-a62f-4a02-8ddf-469bed9fd3f8 service nova] Enqueued Resource ID: 4624546f-4991-4808-9acc-ede283d1b60f with Priority: HIGHEST for action port [ 1262.569253] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1262.570086] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1262.570086] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4624546f-4991-4808-9acc-ede283d1b60f with Priority: HIGHEST for action port [ 1262.570086] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.570086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.570460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.570460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.570460] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.571376] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.571472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.571953] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-4624546f-4991-4808-9acc-ede283d1b60f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.572075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.572202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.572314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.572394] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4624546f-4991-4808-9acc-ede283d1b60f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.938114] env[69274]: INFO networking_nsxv3.common.synchronization [req-3494a84c-cbb8-43b8-bce9-e0c4b8b8a343 req-d882a218-0b35-4808-bc71-1efcea1a5c1a tempest-AttachVolumeShelveTestJSON-972356808 tempest-AttachVolumeShelveTestJSON-972356808-project-member] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1262.938643] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGHEST for action security_group_members [ 1262.938983] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.939252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.939335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.939563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.939754] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.939866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.939930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.940137] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.940233] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.940330] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.074500] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.074655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.074862] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4624546f-4991-4808-9acc-ede283d1b60f with status ACTIVE [ 1263.076637] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.076821] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.076902] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.077695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.077806] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.078057] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.078133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.078194] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.078356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.078443] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.078630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.078846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.078846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.079084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.079084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.079163] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4624546f-4991-4808-9acc-ede283d1b60f is going to be updated. [ 1263.101911] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.102140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.102220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.102664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.102664] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.102915] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4624546f-4991-4808-9acc-ede283d1b60f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.294981] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-e6766cae-93b5-40fb-8bc8-eb77e83c4672 tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1263.294981] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1263.294981] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.294981] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.445073] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.445073] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.445073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.445073] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 is going to be updated. [ 1263.474227] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.474227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.474227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.474227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.474227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.483170] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: IN_PROGRESS for 2s [ 1263.557602] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.557825] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.557997] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.558310] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.558910] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.559288] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.559501] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.559852] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.560098] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.560393] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.560529] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.560654] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.560771] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.560893] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.561018] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.561176] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.579528] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.579841] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1263.579841] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.579947] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-796" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.580397] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-a1c3d897-aed6-4848-ab9a-8c2bd0066031 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.581139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.581139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.581139] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.581319] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1c3d897-aed6-4848-ab9a-8c2bd0066031',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.592621] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1263.592833] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 deletion is rescheduled due to dependency. [ 1263.592961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.593152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.593375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.593563] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.593686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.593752] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.593908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.594015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.594132] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.083739] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.083986] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.084227] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.084657] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.084894] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.085219] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port a1c3d897-aed6-4848-ab9a-8c2bd0066031 not found, creating... [ 1264.085680] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.085880] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.086035] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.086291] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.086447] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.086771] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.086991] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.087111] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.087404] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.088015] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.088015] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: a1c3d897-aed6-4848-ab9a-8c2bd0066031 is going to be created. [ 1264.097027] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.107702] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.107919] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.108062] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.108375] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.108622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.108854] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.598404] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.828410] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-ad945132-fd15-426c-a52a-a0bcf9217374 service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1264.828410] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-ad945132-fd15-426c-a52a-a0bcf9217374 service nova] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1264.828410] env[69274]: INFO networking_nsxv3.common.synchronization [req-4fe97f9b-4f35-4351-9d8b-922f00a6574f req-ad945132-fd15-426c-a52a-a0bcf9217374 service nova] Enqueued Resource ID: a1c3d897-aed6-4848-ab9a-8c2bd0066031 with Priority: HIGHEST for action port [ 1264.828410] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_rules [ 1264.828410] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1264.828410] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c3d897-aed6-4848-ab9a-8c2bd0066031 with Priority: HIGHEST for action port [ 1264.828410] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.828410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.828806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.829099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.829424] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1c3d897-aed6-4848-ab9a-8c2bd0066031 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.829691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.829855] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.830171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.830370] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1c3d897-aed6-4848-ab9a-8c2bd0066031',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.101432] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.101617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.101617] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.101838] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.101933] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.102053] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1265.129949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.130229] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.130299] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.130518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.130668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.141656] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1265.333305] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1c3d897-aed6-4848-ab9a-8c2bd0066031 with status ACTIVE [ 1265.333548] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.333687] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.333769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.333968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.334080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.334267] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.334371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.334426] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.334583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.334660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.334842] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.334935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.335011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.335199] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.335283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.335374] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1c3d897-aed6-4848-ab9a-8c2bd0066031 is going to be updated. [ 1265.356527] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.356719] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.356790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.356997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.357228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.357328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1c3d897-aed6-4848-ab9a-8c2bd0066031" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.492799] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 in Status: SUCCESS [ 1265.493109] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 deletion is rescheduled due to dependency. [ 1265.493298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.156800] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 4s [ 1269.169478] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1269.169848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.170020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.170239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.170484] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.170618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.170689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.170854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.171029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.171097] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.171131] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.172769] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.173789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.173789] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.173789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.173789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.173789] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.174558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.174558] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.620427] env[69274]: INFO networking_nsxv3.common.synchronization [req-493ad02c-b6c5-484b-bdd7-853a9c5a898c req-16f842d8-6659-4e55-a80f-ad5e288abcaf tempest-AttachVolumeTestJSON-1843383484 tempest-AttachVolumeTestJSON-1843383484-project-member] Enqueued Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_members [ 1269.620720] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGHEST for action security_group_members [ 1269.621147] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.621293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.621357] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.621745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.621827] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.621908] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.621967] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.622111] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.622225] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.622331] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.673904] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.674064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.676516] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.124564] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.124815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.124815] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.125116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.125227] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.125438] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.125540] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.125599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.125786] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.125878] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.125964] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac is going to be updated. [ 1270.177038] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.177527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.177527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.177527] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.177695] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.178883] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.187889] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac in Status: IN_PROGRESS for 2s [ 1270.685038] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.685038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.685038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.685038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.685038] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.685038] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1270.709901] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.710132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.710132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.710371] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.710542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.719512] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1272.196659] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac in Status: SUCCESS [ 1272.197059] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac deletion is rescheduled due to dependency. [ 1272.197059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.730192] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1272.730520] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.730649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.730882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.731099] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.731226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.731296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.731454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.731536] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.731632] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.233882] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.735671] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.239041] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.239041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.239041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.239558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.239558] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.239558] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1274.277827] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.278134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.278134] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.278274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.278488] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.295288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1274.621856] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.622118] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1275.543838] env[69274]: INFO networking_nsxv3.common.synchronization [req-53323c4d-e366-4992-a322-eceaac7512b1 req-ce2dc49f-2819-4e93-b13f-87fffef6d82c tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1275.544402] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1275.544709] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.544812] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.613701] env[69274]: INFO networking_nsxv3.common.synchronization [req-0efdf5e3-e0c2-425d-ab68-82a74b1a113a req-3c2c6b5f-59e5-43d0-8661-70aa266b2c75 tempest-MultipleCreateTestJSON-567236747 tempest-MultipleCreateTestJSON-567236747-project-member] Enqueued Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1275.614392] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 with Priority: HIGHEST for action security_group_members [ 1275.614751] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.614862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.309030] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1276.309281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.309510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.309771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.309985] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.310135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.310210] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.310355] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.310430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.310543] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.310708] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.310811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.310881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.311228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.311409] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.311621] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.311703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.311872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.312032] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.312113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.312190] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.313381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.313524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.314014] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.314014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.314014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.314465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.314465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.314605] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.817063] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c85e3b3c-2e63-4ab4-8fe3-1ccaad491259: rpc.has_security_group_logging(os_id): False [ 1276.818064] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.818207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.818277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.818486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.818575] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.818761] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.818864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.818923] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.819116] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.819217] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.819315] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1276.838757] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.838951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.838951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.839221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.839335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.839600] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.839714] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.839775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.839968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.840059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.840324] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.840423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.840494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.840627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.840703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.840903] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.841037] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.841108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.841212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.841291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.841379] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1276.858034] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.858179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.858179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.858397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.858549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.868657] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1276.915915] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.916141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.916206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.916381] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.916532] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.934684] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1278.878470] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1278.878852] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 deletion is rescheduled due to dependency. [ 1278.878852] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.878961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.879186] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.879381] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.879497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.879564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.879725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.879808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.879904] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.948759] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1278.948996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.949168] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.949391] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.949509] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c85e3b3c-2e63-4ab4-8fe3-1ccaad491259',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.382469] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.382469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.382469] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.382635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.382716] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.382900] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.383105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.383105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.383256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.384107] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.384107] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be updated. [ 1279.410313] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.410477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.410604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.410884] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.411117] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.423452] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: IN_PROGRESS for 2s [ 1279.479660] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.479660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.479660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.479978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.479978] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.480057] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 is going to be deleted. [ 1279.536878] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.537147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.537147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.537289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.537364] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.537490] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.615633] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.616100] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1281.434989] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 in Status: SUCCESS [ 1281.435231] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c85e3b3c-2e63-4ab4-8fe3-1ccaad491259 deletion is rescheduled due to dependency. [ 1281.435356] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c85e3b3c-2e63-4ab4-8fe3-1ccaad491259" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.598649] env[69274]: INFO networking_nsxv3.common.synchronization [None req-233c1b2c-479e-49de-8202-659c82191aaf None None] Enqueued Resource ID: 5f0d0ef2-876b-4564-b5fb-60ae80257cd1 with Priority: HIGHEST for action port [ 1284.598649] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f0d0ef2-876b-4564-b5fb-60ae80257cd1 with Priority: HIGHEST for action port [ 1284.598649] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f0d0ef2-876b-4564-b5fb-60ae80257cd1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.598649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f0d0ef2-876b-4564-b5fb-60ae80257cd1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.598649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f0d0ef2-876b-4564-b5fb-60ae80257cd1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.599568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f0d0ef2-876b-4564-b5fb-60ae80257cd1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.599815] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f0d0ef2-876b-4564-b5fb-60ae80257cd1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.102886] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f0d0ef2-876b-4564-b5fb-60ae80257cd1 [ 1285.102886] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.102886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.102886] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.103257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.103257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.103358] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f0d0ef2-876b-4564-b5fb-60ae80257cd1 already deleted. [ 1285.103397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f0d0ef2-876b-4564-b5fb-60ae80257cd1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.881627] env[69274]: INFO networking_nsxv3.common.synchronization [None req-6fbd8125-2629-4fc2-8687-351436ddbb29 None None] Enqueued Resource ID: 76a3054b-154a-4a41-93a7-4c190bbe1ce6 with Priority: HIGHEST for action port [ 1286.882053] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76a3054b-154a-4a41-93a7-4c190bbe1ce6 with Priority: HIGHEST for action port [ 1286.882495] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-76a3054b-154a-4a41-93a7-4c190bbe1ce6 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.882628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76a3054b-154a-4a41-93a7-4c190bbe1ce6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.882697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76a3054b-154a-4a41-93a7-4c190bbe1ce6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.882962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76a3054b-154a-4a41-93a7-4c190bbe1ce6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.883060] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76a3054b-154a-4a41-93a7-4c190bbe1ce6',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.385923] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76a3054b-154a-4a41-93a7-4c190bbe1ce6 [ 1287.386187] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.386548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.386548] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.386748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.386873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.386936] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76a3054b-154a-4a41-93a7-4c190bbe1ce6 already deleted. [ 1287.387070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76a3054b-154a-4a41-93a7-4c190bbe1ce6" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.742674] env[69274]: INFO networking_nsxv3.common.synchronization [None req-63166bc9-f2d5-4250-816f-b9f12a8a1e64 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_rules [ 1289.743261] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_rules [ 1289.743979] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.743979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.743979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.744249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.744249] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.822027] env[69274]: INFO networking_nsxv3.common.synchronization [None req-12b5c4b1-adb0-4889-b41e-6b8c2aa3e422 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_rules [ 1289.822968] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_rules [ 1289.823343] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.823458] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.266089] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.266089] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.266349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.266349] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.266447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.266551] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d already deleted. [ 1290.266626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.266771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.266931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.267030] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.789984] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.790432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.790432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.790432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.790432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.790668] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d already deleted. [ 1290.790668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.375570] env[69274]: INFO networking_nsxv3.common.synchronization [req-b455c735-c430-455e-beed-7367a78125fd req-818760b3-af58-48db-b1eb-47acb6c3dc24 tempest-ServerGroupTestJSON-441401820 tempest-ServerGroupTestJSON-441401820-project-member] Enqueued Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_members [ 1291.376118] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_members [ 1291.376447] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.376572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.376646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.376895] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.377058] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.377162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.377226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.377377] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.377464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.377556] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.654283] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.654590] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-950" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.654590] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-950" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.654940] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-950" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.655268] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.655437] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.655630] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.655797] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.655943] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.656321] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.656471] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1291.656593] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1291.656726] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1291.656823] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.656940] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1291.657098] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1291.675701] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1291.675874] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1291.676034] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1291.676287] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-950" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.676612] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-4bb25603-35ba-46e0-a549-1793652c5f9f taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.676791] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.676916] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.677270] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.677419] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bb25603-35ba-46e0-a549-1793652c5f9f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.879247] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.879652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.879652] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.879766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.879854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.880106] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.880221] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.880279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.880450] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.880529] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.880617] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3050e-0398-4c26-89ac-289cb350397a already deleted. [ 1291.880698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.179775] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.180056] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.180210] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.180503] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.180660] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.180822] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 4bb25603-35ba-46e0-a549-1793652c5f9f not found, creating... [ 1292.181106] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.181273] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.181402] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.181622] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.181767] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.182075] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.182242] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.182368] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.182581] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.182721] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.182865] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 4bb25603-35ba-46e0-a549-1793652c5f9f is going to be created. [ 1292.202973] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.203303] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.203463] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.204145] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.204395] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.204628] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.876452] env[69274]: INFO networking_nsxv3.common.synchronization [req-b455c735-c430-455e-beed-7367a78125fd req-03bb285f-ead8-4d01-b205-f855381bb68d service nova] Enqueued Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_rules [ 1292.876648] env[69274]: INFO networking_nsxv3.common.synchronization [req-b455c735-c430-455e-beed-7367a78125fd req-03bb285f-ead8-4d01-b205-f855381bb68d service nova] Enqueued Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_members [ 1292.876855] env[69274]: INFO networking_nsxv3.common.synchronization [req-b455c735-c430-455e-beed-7367a78125fd req-03bb285f-ead8-4d01-b205-f855381bb68d service nova] Enqueued Resource ID: 4bb25603-35ba-46e0-a549-1793652c5f9f with Priority: HIGHEST for action port [ 1292.877058] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_rules [ 1292.877197] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_members [ 1292.877297] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb25603-35ba-46e0-a549-1793652c5f9f with Priority: HIGHEST for action port [ 1292.877881] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.878152] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.878256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.878524] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.878613] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.879934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.879934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.879934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.879934] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.879934] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.880402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.880402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.880402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.880402] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.880402] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.881375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bb25603-35ba-46e0-a549-1793652c5f9f taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.881491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.881561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.881717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.881788] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bb25603-35ba-46e0-a549-1793652c5f9f',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.382969] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.384176] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.384321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.385865] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bb25603-35ba-46e0-a549-1793652c5f9f with status ACTIVE [ 1293.386052] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.386290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.386421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.386641] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.386738] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.386923] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.387040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.387109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.387281] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.387983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.387983] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.387983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.387983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.387983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.387983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.388307] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bb25603-35ba-46e0-a549-1793652c5f9f is going to be updated. [ 1293.409177] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.409363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.409417] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.409610] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.409755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.409920] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bb25603-35ba-46e0-a549-1793652c5f9f" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.886702] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.388968] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.389161] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.389263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.389477] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.389581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.389692] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3050e-0398-4c26-89ac-289cb350397a is going to be created. [ 1294.414137] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.414373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.414373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.414554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.414720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.423928] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3050e-0398-4c26-89ac-289cb350397a in Status: UNINITIALIZED for 2s [ 1295.058780] env[69274]: INFO networking_nsxv3.common.synchronization [req-8dbcfbfd-e681-4424-8600-909ab418694c req-57bd066f-f03c-413c-ae50-a59dd4944929 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_members [ 1295.059405] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_members [ 1295.059724] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.059853] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.059912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.060206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.060375] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.060494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.060530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.060685] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.060771] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.060865] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.353535] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.353741] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.353872] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.354168] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.354443] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.354605] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.354726] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.354950] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.355114] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.355360] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.355491] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1295.355591] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1295.355712] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1295.355822] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.355932] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1295.356087] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1295.374183] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1295.375044] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1295.375044] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1295.375044] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.375044] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-03f9f514-ba7e-47a4-95d9-b509f49ad38e taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.375386] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.375386] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.375639] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.375781] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f9f514-ba7e-47a4-95d9-b509f49ad38e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.563529] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.563725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.563814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.563987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.564108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.564315] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.564430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.564493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.564647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.564728] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.564807] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d already deleted. [ 1295.564894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.878676] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.878890] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.879039] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.879329] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.879487] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.879642] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 03f9f514-ba7e-47a4-95d9-b509f49ad38e not found, creating... [ 1295.879896] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.880074] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.880199] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.880440] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.880597] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.880885] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.881063] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.881189] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.881404] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.881544] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.881686] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 03f9f514-ba7e-47a4-95d9-b509f49ad38e is going to be created. [ 1295.905267] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.905505] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.905642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.905929] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.906182] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.906415] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.434368] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3050e-0398-4c26-89ac-289cb350397a in Status: SUCCESS [ 1296.434779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.434779] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.434997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.435234] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.435345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.435525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.435608] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.435649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.435729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.435919] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.460247] env[69274]: INFO networking_nsxv3.common.synchronization [req-fe868e75-a7a6-4c19-b38a-3934b6a09ba3 req-2c78847c-ea8f-456d-a381-ee069a65b1f2 tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_members [ 1296.460779] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGHEST for action security_group_members [ 1296.461111] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.461236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.461302] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.461594] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.461672] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.461729] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.461781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.461930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.462025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.462119] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.713326] env[69274]: INFO networking_nsxv3.common.synchronization [req-8dbcfbfd-e681-4424-8600-909ab418694c req-6e21badf-9ec6-44ab-994d-edc6808991c6 service nova] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_rules [ 1296.713652] env[69274]: INFO networking_nsxv3.common.synchronization [req-8dbcfbfd-e681-4424-8600-909ab418694c req-6e21badf-9ec6-44ab-994d-edc6808991c6 service nova] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_members [ 1296.713874] env[69274]: INFO networking_nsxv3.common.synchronization [req-8dbcfbfd-e681-4424-8600-909ab418694c req-6e21badf-9ec6-44ab-994d-edc6808991c6 service nova] Enqueued Resource ID: 03f9f514-ba7e-47a4-95d9-b509f49ad38e with Priority: HIGHEST for action port [ 1296.715023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_rules [ 1296.715023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_members [ 1296.715023] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f9f514-ba7e-47a4-95d9-b509f49ad38e with Priority: HIGHEST for action port [ 1296.715461] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.715461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.715461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.715655] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.715708] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.716614] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.716749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.716813] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.717023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.717294] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.717294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.717467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.717467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.717568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.717712] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.718427] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f9f514-ba7e-47a4-95d9-b509f49ad38e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.718607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.718607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.718774] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.718868] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f9f514-ba7e-47a4-95d9-b509f49ad38e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.939293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.939293] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.939293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.940113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.940113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.940113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.940113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.940113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.940113] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.940347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.940347] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.940427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.940465] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.940607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.940663] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.964648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.964889] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.964944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.965230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.965352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.965657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.965772] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.965830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.965989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.966133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.966306] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e is going to be updated. [ 1296.997097] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.997328] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.997389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.997667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.997827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.007565] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e in Status: IN_PROGRESS for 2s [ 1297.221582] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.222628] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03f9f514-ba7e-47a4-95d9-b509f49ad38e with status ACTIVE [ 1297.222841] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.223314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.223314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.223557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.223557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.223694] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.223776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.223835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.223994] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.224101] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.224231] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.224339] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.224401] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.224505] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.224653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.224653] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03f9f514-ba7e-47a4-95d9-b509f49ad38e is going to be updated. [ 1297.225852] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.225995] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.248318] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.248516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.248516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.248730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.248942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.249050] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f9f514-ba7e-47a4-95d9-b509f49ad38e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.442760] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdb3050e-0398-4c26-89ac-289cb350397a: rpc.has_security_group_logging(os_id): False [ 1297.461283] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.461645] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.461737] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.461983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.462151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.462484] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.462642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.462740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.462980] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.463126] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.463396] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.463547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.463644] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.463863] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.463987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.464272] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.464493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.464604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.464814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.464942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.465086] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdb3050e-0398-4c26-89ac-289cb350397a is going to be created. [ 1297.521527] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.521759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.521759] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.521896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.522090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.533439] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdb3050e-0398-4c26-89ac-289cb350397a in Status: IN_PROGRESS for 2s [ 1297.726938] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.229928] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.230169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.230224] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.230413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.230510] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.230615] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d is going to be created. [ 1298.262474] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.262636] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.262709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.262979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.263135] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.277489] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: UNINITIALIZED for 2s [ 1299.018212] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e in Status: SUCCESS [ 1299.018630] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e deletion is rescheduled due to dependency. [ 1299.018630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.545972] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdb3050e-0398-4c26-89ac-289cb350397a in Status: SUCCESS [ 1299.546240] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.288519] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: SUCCESS [ 1300.288851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.288898] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.289149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.289343] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.289464] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.289530] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.289684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.289770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.289858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.289948] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.792255] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.295075] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a3954e3-aa9a-4782-b4a6-55e15592423d: rpc.has_security_group_logging(os_id): False [ 1301.317930] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.318375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.318375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.318651] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.318897] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.319574] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.319735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.319842] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.320140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.320297] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.320522] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d is going to be created. [ 1301.387075] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.387075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.387075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.387075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.387421] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.405416] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: IN_PROGRESS for 2s [ 1301.715599] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.715861] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1302.550617] env[69274]: INFO networking_nsxv3.common.synchronization [req-743666d7-a31b-48cd-a8be-8702ec0ae2ff req-ae2bf711-6092-490d-8c36-be506c80be7f tempest-ServerGroupTestJSON-441401820 tempest-ServerGroupTestJSON-441401820-project-member] Enqueued Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_members [ 1302.551217] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGHEST for action security_group_members [ 1302.551534] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.551660] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.551755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.551921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.552085] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.552185] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.552239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.552392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.552480] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.552592] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.055661] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.055899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.055899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.056147] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.056251] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.056490] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.056591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.056659] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.056799] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.056879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.056966] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3050e-0398-4c26-89ac-289cb350397a is going to be updated. [ 1303.088873] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.089125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.089125] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.089277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.089420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.098285] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3050e-0398-4c26-89ac-289cb350397a in Status: IN_PROGRESS for 2s [ 1303.418242] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: SUCCESS [ 1303.418498] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.110764] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3050e-0398-4c26-89ac-289cb350397a in Status: SUCCESS [ 1305.111169] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3050e-0398-4c26-89ac-289cb350397a deletion is rescheduled due to dependency. [ 1305.111169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.179794] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.180113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.180113] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.180291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.180405] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.436219] env[69274]: INFO networking_nsxv3.common.synchronization [req-c8527b89-c92b-46b7-9449-7f7eb669b225 req-4b7b128f-3e76-48b3-83d6-9bcf40f9bdbd tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1307.436782] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1307.437112] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.437239] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.437431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.437511] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.437663] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.437770] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.437829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.437983] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.438086] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.438181] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.683371] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.939835] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.188815] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.442438] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.691567] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1308.691567] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1308.945368] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.945697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.945697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.945864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.946052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.946752] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be updated. [ 1308.983715] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.983914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.984012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.984298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.984473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.993871] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 2s [ 1309.458871] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.459197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.459197] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.459385] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.473467] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1309.474564] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.475624] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1309.514355] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.514506] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.514584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.514781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.528035] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.529150] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1309.529150] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1309.529312] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1309.573103] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.573267] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.573341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.573545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.574866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.575124] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1309.668045] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.668212] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.668279] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.668503] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.668849] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.669169] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1309.745056] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.745268] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.745329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.745599] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.745927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.746436] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1309.746553] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5a3954e3-aa9a-4782-b4a6-55e15592423d', 'fd7d0f6f-e583-4619-be1a-10cbd86bd911', '75b08f22-c6d6-4014-88bf-a9fe927483cc', 'fda5f29a-8aee-4dfa-bf8c-4b53899b25f9', 'd1ed1d16-c48a-4859-8659-45390ac1d1a8', 'c1c536af-bbdd-43d4-96ae-ba31d5403fdb', 'e2339818-d892-4139-9105-430d1c6dde2e', 'df948508-d1d6-4368-979c-297ed94dda9d', 'fdb3050e-0398-4c26-89ac-289cb350397a', '425a6912-a0c6-4fca-8187-80a58f8e7880', 'a499f7e4-147f-443a-94fe-27f18e7a8418', '833fffe2-1aa6-4f10-9ea0-4e315ed92177', '0a455007-3894-4ad6-ba01-21ddec4b0019', '15291f2b-281c-4bf0-a609-bcb369c82f51', '644d845b-e0e5-49b2-b970-585c199651e8', 'c6965fde-94e0-450b-9c8a-b2de7355cdc4', 'da1c3475-4204-4218-9478-83b2e1605cd7', '8836cb7d-c446-445d-9406-a28a71bb6de4', '263ec48b-f6d4-4404-82b0-3777225d4fe1', 'c5cb0145-b4ca-4858-acad-7f67f4ef4d84', 'c0cfaaa6-931d-4c7a-9f80-bc3fea212be2', 'cf62572c-aed8-4405-8e2e-513d1f9f3976', '42671b00-adb1-46b6-9948-92a484306fcc', 'fb1c245e-fab2-4558-9acb-1f5c9442e963', 'e6c444ae-af25-4279-9215-0b11d2e72a27', '1fe47e7d-d5da-4198-a8d5-ecc0c017948d', 'e0551ddf-e014-4e0b-b17c-9e30f1dac015', '8653ee19-c57a-46f8-93e1-b1877cf8c937', '08640a4a-b7e4-4d8a-81e0-f0c8623136ac', 'efc14d56-7e2f-4186-9451-37adac5c5b23', 'efef42a0-7879-4e5e-b07d-896b827035c2', '6b037ccd-78b0-43be-acdd-bcc8531b52f5', '5cb5dff3-3fac-48a6-b59f-5932902148b8', 'b3522e3c-b40f-4d43-97bb-6926b26f91d0', '2840b5fb-3a8f-4d93-a381-953dc8e31a67', 'd3e0de07-3f69-422a-b96d-525b1f2d6a80', '55f154d6-8c77-4554-a90c-034e9602b91b', '4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e', 'fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee', 'bf5386bc-1dac-4dfb-a842-4c99e33f110c', 'e054c2da-0582-423b-9cca-a531d11f58d2', '93500972-b84b-40e5-abe8-7eeafad09413', 'a12f01d2-8146-4dc7-b376-a70f9bc9f697'} {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1309.746660] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1309.764648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.764862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.764862] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.765070] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.765155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.765265] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1309.765414] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1309.765500] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1309.843937] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.844188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.844188] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.844392] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.845683] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.845976] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1309.846073] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1309.846151] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1309.846220] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1309.846345] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1309.846507] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGH for action security_group_rules [ 1309.846615] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGH for action security_group_rules [ 1309.846688] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGH for action security_group_rules [ 1309.846754] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGH for action security_group_rules [ 1309.846820] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGH for action security_group_rules [ 1309.846884] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGH for action security_group_rules [ 1309.846946] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGH for action security_group_rules [ 1309.847024] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGH for action security_group_rules [ 1309.847090] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGH for action security_group_rules [ 1309.847154] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGH for action security_group_rules [ 1309.847217] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGH for action security_group_rules [ 1309.847280] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGH for action security_group_rules [ 1309.847348] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGH for action security_group_rules [ 1309.847417] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGH for action security_group_rules [ 1309.847510] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGH for action security_group_rules [ 1309.847578] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGH for action security_group_rules [ 1309.847642] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGH for action security_group_rules [ 1309.847705] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGH for action security_group_rules [ 1309.847768] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGH for action security_group_rules [ 1309.847831] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGH for action security_group_rules [ 1309.847929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.004084] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1311.004472] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.437896] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.438290] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1312.438290] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGH for action security_group_rules [ 1312.438290] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc with Priority: HIGH for action security_group_rules [ 1312.438433] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGH for action security_group_rules [ 1312.438433] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644d845b-e0e5-49b2-b970-585c199651e8 with Priority: HIGH for action security_group_rules [ 1312.438521] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 with Priority: HIGH for action security_group_rules [ 1312.438594] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 with Priority: HIGH for action security_group_rules [ 1312.438688] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 with Priority: HIGH for action security_group_rules [ 1312.438782] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da1c3475-4204-4218-9478-83b2e1605cd7 with Priority: HIGH for action security_group_rules [ 1312.438874] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 with Priority: HIGH for action security_group_rules [ 1312.438966] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 with Priority: HIGH for action security_group_rules [ 1312.439069] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 with Priority: HIGH for action security_group_rules [ 1312.439162] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 with Priority: HIGH for action security_group_rules [ 1312.439254] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a499f7e4-147f-443a-94fe-27f18e7a8418 with Priority: HIGH for action security_group_rules [ 1312.439344] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 with Priority: HIGH for action security_group_rules [ 1312.439433] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3050e-0398-4c26-89ac-289cb350397a with Priority: HIGH for action security_group_rules [ 1312.439521] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb with Priority: HIGH for action security_group_rules [ 1312.439611] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df948508-d1d6-4368-979c-297ed94dda9d with Priority: HIGH for action security_group_rules [ 1312.439700] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 with Priority: HIGH for action security_group_rules [ 1312.439789] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 with Priority: HIGH for action security_group_rules [ 1312.439878] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 with Priority: HIGH for action security_group_rules [ 1312.440234] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.440363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.440432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.440646] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.440728] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.441710] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75b08f22-c6d6-4014-88bf-a9fe927483cc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.441831] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.441900] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.442082] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.442162] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75b08f22-c6d6-4014-88bf-a9fe927483cc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.442921] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.443042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.443112] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.443284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.443365] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.444199] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-644d845b-e0e5-49b2-b970-585c199651e8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.444298] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.444370] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.444522] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.444595] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('644d845b-e0e5-49b2-b970-585c199651e8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.445273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.445411] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.445515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.445675] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.445752] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cb0145-b4ca-4858-acad-7f67f4ef4d84',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.446450] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-263ec48b-f6d4-4404-82b0-3777225d4fe1 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.446563] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.446632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.446785] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.446859] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('263ec48b-f6d4-4404-82b0-3777225d4fe1',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.447521] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8836cb7d-c446-445d-9406-a28a71bb6de4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.447627] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.447696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.447843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.447915] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8836cb7d-c446-445d-9406-a28a71bb6de4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.448682] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da1c3475-4204-4218-9478-83b2e1605cd7 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.448781] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.448850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.449011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.449087] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da1c3475-4204-4218-9478-83b2e1605cd7',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.449763] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15291f2b-281c-4bf0-a609-bcb369c82f51 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.449829] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.449893] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.450057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.450127] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15291f2b-281c-4bf0-a609-bcb369c82f51',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.450775] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.450883] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.450950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.451115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.451188] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6965fde-94e0-450b-9c8a-b2de7355cdc4',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.451831] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a455007-3894-4ad6-ba01-21ddec4b0019 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.451937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.452011] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.452163] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.452238] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a455007-3894-4ad6-ba01-21ddec4b0019',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.454685] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.454790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.454854] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.455030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.455087] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('833fffe2-1aa6-4f10-9ea0-4e315ed92177',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.455758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a499f7e4-147f-443a-94fe-27f18e7a8418 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.455866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.455935] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.456099] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.456172] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a499f7e4-147f-443a-94fe-27f18e7a8418',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.456952] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-425a6912-a0c6-4fca-8187-80a58f8e7880 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.456952] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.457057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.457140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.457211] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('425a6912-a0c6-4fca-8187-80a58f8e7880',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.457899] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdb3050e-0398-4c26-89ac-289cb350397a taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.458025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.458095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.458431] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.458514] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdb3050e-0398-4c26-89ac-289cb350397a',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.459181] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.459288] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.459425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.459593] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.459666] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1c536af-bbdd-43d4-96ae-ba31d5403fdb',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.460423] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df948508-d1d6-4368-979c-297ed94dda9d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.460531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.460598] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.460747] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.460819] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df948508-d1d6-4368-979c-297ed94dda9d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.461473] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.461580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.461647] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.461795] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.461870] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1ed1d16-c48a-4859-8659-45390ac1d1a8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.462519] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.462632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.462703] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.462850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.462924] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd7d0f6f-e583-4619-be1a-10cbd86bd911',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.463684] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.463793] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.463860] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.464009] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.464084] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fda5f29a-8aee-4dfa-bf8c-4b53899b25f9',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.490824] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.491062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.491062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.491209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.493914] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.494102] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.494769] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.494861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.510348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.510513] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75b08f22-c6d6-4014-88bf-a9fe927483cc is going to be deleted. [ 1312.511335] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.511580] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.529743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.529918] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 833fffe2-1aa6-4f10-9ea0-4e315ed92177 is going to be deleted. [ 1312.530751] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.530965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.549059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.549235] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 644d845b-e0e5-49b2-b970-585c199651e8 is going to be deleted. [ 1312.563820] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.564059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.564059] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.564277] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.564375] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.564509] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75b08f22-c6d6-4014-88bf-a9fe927483cc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.580737] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.580971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.580971] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.581255] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.581374] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.581507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-833fffe2-1aa6-4f10-9ea0-4e315ed92177" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.603623] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.603822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.603822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.604020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.604209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.604363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-644d845b-e0e5-49b2-b970-585c199651e8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.981078] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.981325] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.981396] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.981616] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.981822] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.981942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.982017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.982215] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.982312] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.982430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.982528] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.983640] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.983808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.983808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.983966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.984148] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.984238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.984326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.984550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.984628] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.984697] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.984835] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.005601] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.005840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.005948] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.006230] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.043722] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.044026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.044749] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.044881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.045579] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.045678] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.046331] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.046432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.047123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.047220] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.047926] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.048052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.048750] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.048848] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.049539] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.049638] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.050334] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.050427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.051057] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.051155] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.051753] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.052190] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.052314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.052858] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.053288] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.053394] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.054280] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.054662] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.054757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.055340] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.055816] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.055966] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15291f2b-281c-4bf0-a609-bcb369c82f51 is going to be deleted. [ 1313.058300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.058410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.058467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.058669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.085780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.085927] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fda5f29a-8aee-4dfa-bf8c-4b53899b25f9 is going to be deleted. [ 1313.087142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.087386] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.108031] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.108198] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8836cb7d-c446-445d-9406-a28a71bb6de4 is going to be deleted. [ 1313.109067] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.109289] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.119472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.119661] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.128906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.129072] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdb3050e-0398-4c26-89ac-289cb350397a is going to be deleted. [ 1313.129905] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.130146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.156825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.157044] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da1c3475-4204-4218-9478-83b2e1605cd7 is going to be deleted. [ 1313.157941] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.158183] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.174600] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.174822] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.183840] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.184040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.213684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.213684] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a499f7e4-147f-443a-94fe-27f18e7a8418 is going to be deleted. [ 1313.214341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.214561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.234907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.235052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.280139] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.280286] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 425a6912-a0c6-4fca-8187-80a58f8e7880 is going to be deleted. [ 1313.281551] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.281750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.307875] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.308124] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.308940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.309076] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6965fde-94e0-450b-9c8a-b2de7355cdc4 is going to be deleted. [ 1313.310073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.310303] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.341283] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.341518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.349709] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.349895] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a455007-3894-4ad6-ba01-21ddec4b0019 is going to be deleted. [ 1313.350827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.351071] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.421667] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.421894] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1ed1d16-c48a-4859-8659-45390ac1d1a8 is going to be deleted. [ 1313.422804] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.423052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.424618] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.424724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.495668] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.495668] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd7d0f6f-e583-4619-be1a-10cbd86bd911 is going to be deleted. [ 1313.496778] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.496916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.496965] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.497177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.497346] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.497447] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.497517] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.497676] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.497775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.497864] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.498019] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.498118] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.498182] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.498326] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.498465] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.498554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.498618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.498757] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.498835] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.498918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.499016] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.500620] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.500788] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.501758] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.545522] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.545734] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.547241] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.547354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.551951] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.552095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.561486] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.561632] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df948508-d1d6-4368-979c-297ed94dda9d is going to be deleted. [ 1313.562544] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.562777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.623587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.623777] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 263ec48b-f6d4-4404-82b0-3777225d4fe1 is going to be deleted. [ 1313.624666] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.624891] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.668354] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.668649] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.669476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.669600] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1c536af-bbdd-43d4-96ae-ba31d5403fdb is going to be deleted. [ 1313.670497] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.670715] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.678527] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.678713] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.711264] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.711448] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cb0145-b4ca-4858-acad-7f67f4ef4d84 is going to be deleted. [ 1313.712321] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.712545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.712642] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.712776] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15291f2b-281c-4bf0-a609-bcb369c82f51" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.712932] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.713114] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.713196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.713351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fda5f29a-8aee-4dfa-bf8c-4b53899b25f9" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.713845] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.714012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.714103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.714228] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8836cb7d-c446-445d-9406-a28a71bb6de4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.714363] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.714508] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.714587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.714701] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdb3050e-0398-4c26-89ac-289cb350397a" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.714827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.714966] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.715057] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.715166] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da1c3475-4204-4218-9478-83b2e1605cd7" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.715284] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.715476] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.715542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.715658] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a499f7e4-147f-443a-94fe-27f18e7a8418" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.715782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.715926] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.716010] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.716130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-425a6912-a0c6-4fca-8187-80a58f8e7880" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.716252] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.716420] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.716483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.716600] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a455007-3894-4ad6-ba01-21ddec4b0019" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.716723] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.716865] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.716944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.717075] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6965fde-94e0-450b-9c8a-b2de7355cdc4" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.717196] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.717338] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.717409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.717515] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1ed1d16-c48a-4859-8659-45390ac1d1a8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.717640] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.717775] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.717851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.717962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd7d0f6f-e583-4619-be1a-10cbd86bd911" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.718132] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.718273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.718351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.718461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df948508-d1d6-4368-979c-297ed94dda9d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.780963] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.781138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.781202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.781419] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.781591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.781654] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-263ec48b-f6d4-4404-82b0-3777225d4fe1" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.803503] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.803692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.803692] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.803887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.803979] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.804138] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1c536af-bbdd-43d4-96ae-ba31d5403fdb" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.872422] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.872952] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.873105] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.873179] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.873408] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.873487] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.873613] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cb0145-b4ca-4858-acad-7f67f4ef4d84" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.003497] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2339818-d892-4139-9105-430d1c6dde2e: rpc.has_security_group_logging(os_id): False [ 1314.004941] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a3954e3-aa9a-4782-b4a6-55e15592423d: rpc.has_security_group_logging(os_id): False [ 1314.028025] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.028025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.028025] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.028313] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.030027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.030027] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.053051] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.053256] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.053256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.053256] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.053466] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.053581] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.053627] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d is going to be updated. [ 1314.054702] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.054868] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.079246] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.079542] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.079665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.079735] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.079937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.080040] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.080240] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.080341] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.080407] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.080555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.080633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.080810] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.080906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.080968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.081123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.081201] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.081300] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be updated. [ 1314.132549] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.133811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.133811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.133811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.133811] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.150462] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.150669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.150669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.150958] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.151129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.152951] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: IN_PROGRESS for 2s [ 1314.163066] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 2s [ 1314.203816] env[69274]: INFO networking_nsxv3.common.synchronization [req-695193ed-691b-4982-b764-d92855460d22 req-6b271d59-4e37-4654-983c-c96a4114a2b8 tempest-ServerRescueNegativeTestJSON-807175379 tempest-ServerRescueNegativeTestJSON-807175379-project-member] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1314.204415] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGHEST for action security_group_members [ 1314.204745] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.204872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.204937] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.205145] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.205300] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.205422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.205491] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.205648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.205733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.205830] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.709030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.709030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.709030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.709542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.709542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.709542] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.709542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.709542] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.709745] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.709783] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.709842] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be updated. [ 1314.750675] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.750917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.750917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.751115] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.751265] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.762716] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: IN_PROGRESS for 2s [ 1316.183330] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1316.183743] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.184360] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: SUCCESS [ 1316.184554] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.773275] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2339818-d892-4139-9105-430d1c6dde2e in Status: SUCCESS [ 1316.773482] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2339818-d892-4139-9105-430d1c6dde2e deletion is rescheduled due to dependency. [ 1316.773555] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.205019] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.205549] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.206821] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.207169] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.208366] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.208735] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1334.210291] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.210666] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.212101] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1339.212452] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1344.213484] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.213833] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.214570] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.214939] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.215895] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.216264] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.217172] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.217674] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.218694] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.219148] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.219672] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.220048] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.220832] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.220832] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.221805] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.221805] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.222897] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.223311] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.224238] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.224597] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.306570] env[69274]: INFO networking_nsxv3.common.synchronization [req-9872e004-7d40-4f09-8e0c-e41369bc0bc2 req-6027279a-ab32-4ca7-b5e7-f9a9c161a1c1 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_members [ 1390.307181] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGHEST for action security_group_members [ 1390.308123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.308274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.308373] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.308601] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.308767] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.308881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.308946] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.309142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.309242] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.309343] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.811949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.812293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.812293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.812461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.812533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.812684] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.812784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.812851] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.812989] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.813079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.813160] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d is going to be updated. [ 1390.851668] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.851954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.851954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.852103] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.852247] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.860641] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: IN_PROGRESS for 2s [ 1392.872836] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d in Status: SUCCESS [ 1392.873280] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d deletion is rescheduled due to dependency. [ 1392.873280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.308440] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.308681] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.309726] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.309726] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.311023] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.311378] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.312055] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.312055] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.313348] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.313813] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.314387] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.314751] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.423013] env[69274]: INFO networking_nsxv3.common.synchronization [req-9c15673e-57b8-43c9-9ef3-1e40f4ba942c req-e6549d5e-8980-4605-91af-9eb7919bd6dd tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1423.423569] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1423.423876] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.424167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.424167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.424383] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.424460] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.424552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.424612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.424763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.425461] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.425607] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.928648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.928832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.928832] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.929048] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.951127] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.951392] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.951519] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.951590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.951800] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.951885] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.951976] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1423.979976] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.980172] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.980206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.980423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.980574] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.989724] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1426.001288] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1426.001587] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 deletion is rescheduled due to dependency. [ 1426.001587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.424468] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.424911] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.414780] env[69274]: INFO networking_nsxv3.common.synchronization [req-7289341b-87b1-49ea-8a19-93e8dab50435 req-e15501eb-f58c-4eec-b1e1-ed80ccdf4f7c tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1430.415419] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1430.415640] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.415764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.415834] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.416049] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.416224] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.416336] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.416389] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.416547] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.416632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.416733] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.697908] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.697908] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.697908] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.698158] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.698337] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.698505] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.698630] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.698859] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.699020] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.699294] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1430.699449] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1430.699616] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1430.699752] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1430.699878] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1430.699991] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1430.700144] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1430.720954] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1430.721155] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1430.721302] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1430.721494] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.721820] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-fd0df617-94cc-476f-be81-7b5daf12b523 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.721998] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.722142] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.722501] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.722653] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd0df617-94cc-476f-be81-7b5daf12b523',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.919855] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.920090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.920090] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.920266] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.920366] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.920583] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.920691] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.920755] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.920912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.920991] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.921092] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1430.947843] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.948062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.948062] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.948290] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.948435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.957796] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1431.225031] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.225472] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.225775] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.226171] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.226390] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.226583] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port fd0df617-94cc-476f-be81-7b5daf12b523 not found, creating... [ 1431.226847] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.227115] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.227165] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.227420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.227571] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.227877] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.228059] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.228399] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.228399] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.228543] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.228689] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: fd0df617-94cc-476f-be81-7b5daf12b523 is going to be created. [ 1431.267499] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.267747] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.267856] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.268212] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.268460] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.268704] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.921984] env[69274]: INFO networking_nsxv3.common.synchronization [req-7289341b-87b1-49ea-8a19-93e8dab50435 req-56413ffe-205f-4260-8201-7face63234a0 service nova] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1431.922262] env[69274]: INFO networking_nsxv3.common.synchronization [req-7289341b-87b1-49ea-8a19-93e8dab50435 req-56413ffe-205f-4260-8201-7face63234a0 service nova] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1431.922262] env[69274]: INFO networking_nsxv3.common.synchronization [req-7289341b-87b1-49ea-8a19-93e8dab50435 req-56413ffe-205f-4260-8201-7face63234a0 service nova] Enqueued Resource ID: fd0df617-94cc-476f-be81-7b5daf12b523 with Priority: HIGHEST for action port [ 1431.922516] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1431.922646] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1431.922744] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd0df617-94cc-476f-be81-7b5daf12b523 with Priority: HIGHEST for action port [ 1431.923758] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.923914] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.924018] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.924276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.924395] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.925475] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.925475] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.925681] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd0df617-94cc-476f-be81-7b5daf12b523 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.925876] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.925929] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.926273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.926392] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd0df617-94cc-476f-be81-7b5daf12b523',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.428410] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.428607] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.428693] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd0df617-94cc-476f-be81-7b5daf12b523 with status ACTIVE [ 1432.428864] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.428996] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.429064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.429272] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.429368] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.429565] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.429679] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.429740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.430198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.430198] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.430198] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.430351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.430351] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.430462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.430537] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.430658] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd0df617-94cc-476f-be81-7b5daf12b523 is going to be updated. [ 1432.451209] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.451422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.451422] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.451587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.451717] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.451875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd0df617-94cc-476f-be81-7b5daf12b523" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.966568] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1432.966855] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 deletion is rescheduled due to dependency. [ 1432.966855] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.967657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.967657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.967657] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.967657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.967657] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.967888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.967888] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.967955] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.470060] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.972792] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.475555] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.475740] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.475784] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.475998] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.477095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.477095] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1434.503681] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.503867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.503867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.504093] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.504232] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.513099] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1436.525174] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1436.525501] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.525571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.525763] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.525956] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.526084] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.526148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.526339] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.526427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.526518] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.526611] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.924054] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.924294] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1437.028850] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.532825] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8653ee19-c57a-46f8-93e1-b1877cf8c937: rpc.has_security_group_logging(os_id): False [ 1437.549361] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.549549] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.549586] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.549872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.550382] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.550382] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.550553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.550553] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.550669] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.550762] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.550825] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1437.608325] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.608539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.608539] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.608846] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.608918] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.619053] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1439.633514] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1439.633894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.925122] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.925552] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.926541] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.926938] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.927787] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.928213] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.928727] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.929166] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.930076] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.930411] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.931451] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.931866] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.933286] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.933286] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.934907] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.935247] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.936789] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.936789] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.938016] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.938346] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.939746] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.939746] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.225984] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1492.225984] env[69274]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-bf069e14-58db-4e09-b8b7-90cf025b2bbd None None] NSXv3 Agent Agent loop - iteration:4 started [ 1496.940426] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.940750] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.941881] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.942293] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.943520] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.943903] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.863302] env[69274]: INFO networking_nsxv3.common.synchronization [req-206f6ea6-eb21-4804-ab20-1e7125870433 req-e6d3103a-9c71-40fa-a8dc-7a5621ca0db5 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1511.864268] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1511.865150] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.865150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.865150] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.865263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.865393] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.865504] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.865569] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.865736] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.865827] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.865924] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.370985] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.371473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.371656] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.371961] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.372171] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.372477] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.372710] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.372872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.373143] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.373352] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.373537] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1512.408108] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.408108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.408108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.408108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.408108] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.415991] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1514.427518] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1514.427874] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 deletion is rescheduled due to dependency. [ 1514.427874] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.865445] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.865832] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.955722] env[69274]: INFO networking_nsxv3.common.synchronization [req-90734435-ef4a-4054-947e-e269e0469629 req-8d7c5233-30f2-4255-8362-3f20591aa26a tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1520.956273] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1520.956584] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.956724] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.956782] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.957033] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.957173] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.957276] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.957344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.957482] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.957606] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.957717] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.198026] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.198026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.198026] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.198227] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.199572] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.199572] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.199572] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.199572] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.199572] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.199572] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1521.199572] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] NeedRegenerationException {{(pid=69274) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1521.199921] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] no value, waiting for create lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1521.199921] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] value creation lock acquired {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1521.199921] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] No value present for key: 'zone-id' {{(pid=69274) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1521.200017] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Calling creation function for not-yet-present value {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1521.200212] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1521.229642] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1521.229833] env[69274]: DEBUG dogpile.cache.region [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69274) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1521.229960] env[69274]: DEBUG dogpile.lock [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Released creation lock {{(pid=69274) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1521.230208] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "network-790" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.230531] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock port-772e3fd5-9921-4977-afed-4c2803daf470 taken with stack trace [, , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.230712] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.230835] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.231233] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.231379] env[69274]: DEBUG networking_nsxv3.api.rpc [None req-3e806fe3-2059-48f4-af76-766176435704 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772e3fd5-9921-4977-afed-4c2803daf470',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.459806] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.460023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.460023] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.460222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.460315] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.460516] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.460618] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.460681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.460861] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.461014] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.461014] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1521.492250] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.492423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.492463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.492653] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.492794] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.501620] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1521.733806] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.733997] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.734161] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.734420] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.734588] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.734763] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Segment Port 772e3fd5-9921-4977-afed-4c2803daf470 not found, creating... [ 1521.735046] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.735221] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.735347] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.735585] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.735732] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.736052] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.736219] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.736344] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.736563] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.736702] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.736893] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Resource: SegmentPort with ID: 772e3fd5-9921-4977-afed-4c2803daf470 is going to be created. [ 1521.756910] env[69274]: DEBUG networking_nsxv3.common.locking [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.757210] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.757357] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.757642] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.757895] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.758165] env[69274]: DEBUG oslo_concurrency.lockutils [None req-3e806fe3-2059-48f4-af76-766176435704 None None] Releasing lock "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.425322] env[69274]: INFO networking_nsxv3.common.synchronization [req-90734435-ef4a-4054-947e-e269e0469629 req-2121fb5c-d5af-4533-a42b-27b4be565c18 service nova] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1522.425597] env[69274]: INFO networking_nsxv3.common.synchronization [req-90734435-ef4a-4054-947e-e269e0469629 req-2121fb5c-d5af-4533-a42b-27b4be565c18 service nova] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1522.425701] env[69274]: INFO networking_nsxv3.common.synchronization [req-90734435-ef4a-4054-947e-e269e0469629 req-2121fb5c-d5af-4533-a42b-27b4be565c18 service nova] Enqueued Resource ID: 772e3fd5-9921-4977-afed-4c2803daf470 with Priority: HIGHEST for action port [ 1522.425961] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_rules [ 1522.426112] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1522.426212] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 772e3fd5-9921-4977-afed-4c2803daf470 with Priority: HIGHEST for action port [ 1522.426744] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.426921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.426969] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.427169] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.427255] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.428156] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.428206] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.428390] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock port-772e3fd5-9921-4977-afed-4c2803daf470 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.428493] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.428561] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.428730] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.428808] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772e3fd5-9921-4977-afed-4c2803daf470',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.930309] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.930460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.931769] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 772e3fd5-9921-4977-afed-4c2803daf470 with status ACTIVE [ 1522.931950] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.932085] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.932180] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.932362] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.932495] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.932648] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.932760] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.932825] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.932986] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.933083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.933273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.933384] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.933438] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.933571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.933648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.933735] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 772e3fd5-9921-4977-afed-4c2803daf470 is going to be updated. [ 1522.955565] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.955766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.955766] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.955921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.956079] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.956262] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-772e3fd5-9921-4977-afed-4c2803daf470" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.511981] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1523.512295] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 deletion is rescheduled due to dependency. [ 1523.512453] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.512693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.512924] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.513123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.513241] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.513306] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.513463] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.513557] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.513637] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.015862] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.518516] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.021138] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.021339] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.021390] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.021589] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.021693] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.021773] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1525.065327] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.065521] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.065603] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.065858] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.066072] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.076229] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1527.094531] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1527.094894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.094927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.095177] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.095379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.095500] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.095567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.095733] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.095814] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.095901] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.095992] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1527.427014] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.427224] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1527.598248] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.100870] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8653ee19-c57a-46f8-93e1-b1877cf8c937: rpc.has_security_group_logging(os_id): False [ 1528.118992] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.119214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.119214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.119432] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.119572] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.119790] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.119896] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.119945] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.120120] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.120202] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.120290] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1528.177709] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.177894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.177894] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.178149] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.178301] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.190523] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1530.206408] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1530.206753] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.428106] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.428541] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.429611] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.430041] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.430495] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.430898] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.180378] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.180778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.180778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.180778] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.180902] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.431244] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.431406] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.683944] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.187160] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.689450] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1548.689626] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1549.376959] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.377452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.377452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.377452] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.390400] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1549.391226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.392053] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1549.429630] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.429850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.429850] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.430065] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.442454] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.443282] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1549.443363] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.443453] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1549.471691] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.471940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.471940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.472130] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.472758] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.472910] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1549.550196] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.550395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.550395] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.550633] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.550906] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.551209] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1549.621379] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.621588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.621588] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.621819] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.622192] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.622443] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:25. [ 1549.622535] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5a3954e3-aa9a-4782-b4a6-55e15592423d', 'c0cfaaa6-931d-4c7a-9f80-bc3fea212be2', 'cf62572c-aed8-4405-8e2e-513d1f9f3976', '42671b00-adb1-46b6-9948-92a484306fcc', 'fb1c245e-fab2-4558-9acb-1f5c9442e963', 'e6c444ae-af25-4279-9215-0b11d2e72a27', '1fe47e7d-d5da-4198-a8d5-ecc0c017948d', 'e0551ddf-e014-4e0b-b17c-9e30f1dac015', '8653ee19-c57a-46f8-93e1-b1877cf8c937', '08640a4a-b7e4-4d8a-81e0-f0c8623136ac', 'efc14d56-7e2f-4186-9451-37adac5c5b23', 'efef42a0-7879-4e5e-b07d-896b827035c2', '6b037ccd-78b0-43be-acdd-bcc8531b52f5', '5cb5dff3-3fac-48a6-b59f-5932902148b8', 'b3522e3c-b40f-4d43-97bb-6926b26f91d0', '2840b5fb-3a8f-4d93-a381-953dc8e31a67', 'e2339818-d892-4139-9105-430d1c6dde2e', 'd3e0de07-3f69-422a-b96d-525b1f2d6a80', '55f154d6-8c77-4554-a90c-034e9602b91b', '4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e', 'fc5a9f41-bc61-4f34-bdf3-c1505e3c83ee', 'bf5386bc-1dac-4dfb-a842-4c99e33f110c', 'e054c2da-0582-423b-9cca-a531d11f58d2', '93500972-b84b-40e5-abe8-7eeafad09413', 'a12f01d2-8146-4dc7-b376-a70f9bc9f697'} {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.622609] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1549.640123] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.640296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.640296] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.640481] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.640567] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.640677] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1549.640749] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.640821] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1549.717667] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.717882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.717882] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.718123] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.719360] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.719636] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1549.719711] env[69274]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69274) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1549.719790] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1549.719858] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1549.719936] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/25 resources of Type:Security Group Rules [ 1549.720016] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGH for action security_group_rules [ 1549.720103] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGH for action security_group_rules [ 1549.720174] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGH for action security_group_rules [ 1549.720239] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGH for action security_group_rules [ 1549.720301] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGH for action security_group_rules [ 1549.720363] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGH for action security_group_rules [ 1549.720425] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGH for action security_group_rules [ 1549.720498] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGH for action security_group_rules [ 1549.720584] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGH for action security_group_rules [ 1549.720654] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGH for action security_group_rules [ 1549.720732] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGH for action security_group_rules [ 1549.720804] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGH for action security_group_rules [ 1549.720912] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGH for action security_group_rules [ 1549.721033] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGH for action security_group_rules [ 1549.721118] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGH for action security_group_rules [ 1549.721193] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGH for action security_group_rules [ 1549.721333] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGH for action security_group_rules [ 1549.721333] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGH for action security_group_rules [ 1549.721470] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGH for action security_group_rules [ 1549.721470] env[69274]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGH for action security_group_rules [ 1549.721595] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.432109] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.432462] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1552.432462] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d with Priority: HIGH for action security_group_rules [ 1552.432585] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 with Priority: HIGH for action security_group_rules [ 1552.432585] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d with Priority: HIGH for action security_group_rules [ 1552.432675] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 with Priority: HIGH for action security_group_rules [ 1552.432767] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e with Priority: HIGH for action security_group_rules [ 1552.432859] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f154d6-8c77-4554-a90c-034e9602b91b with Priority: HIGH for action security_group_rules [ 1552.432951] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 with Priority: HIGH for action security_group_rules [ 1552.433053] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2339818-d892-4139-9105-430d1c6dde2e with Priority: HIGH for action security_group_rules [ 1552.433149] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 with Priority: HIGH for action security_group_rules [ 1552.433240] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 with Priority: HIGH for action security_group_rules [ 1552.433331] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 with Priority: HIGH for action security_group_rules [ 1552.433419] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efef42a0-7879-4e5e-b07d-896b827035c2 with Priority: HIGH for action security_group_rules [ 1552.433509] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc14d56-7e2f-4186-9451-37adac5c5b23 with Priority: HIGH for action security_group_rules [ 1552.433600] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac with Priority: HIGH for action security_group_rules [ 1552.433689] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGH for action security_group_rules [ 1552.433776] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c444ae-af25-4279-9215-0b11d2e72a27 with Priority: HIGH for action security_group_rules [ 1552.433865] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 with Priority: HIGH for action security_group_rules [ 1552.433955] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 with Priority: HIGH for action security_group_rules [ 1552.434054] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 with Priority: HIGH for action security_group_rules [ 1552.434147] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42671b00-adb1-46b6-9948-92a484306fcc with Priority: HIGH for action security_group_rules [ 1552.434472] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a3954e3-aa9a-4782-b4a6-55e15592423d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.434597] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.434665] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.434879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.434962] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a3954e3-aa9a-4782-b4a6-55e15592423d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.436045] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf62572c-aed8-4405-8e2e-513d1f9f3976 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.436045] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.436238] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.436278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.436334] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf62572c-aed8-4405-8e2e-513d1f9f3976',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.437073] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.437204] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.437274] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.437435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.437502] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fe47e7d-d5da-4198-a8d5-ecc0c017948d',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.438349] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.438471] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.438541] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.438696] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.438810] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3522e3c-b40f-4d43-97bb-6926b26f91d0',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.439533] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.439533] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.439626] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.439750] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.439818] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.440516] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55f154d6-8c77-4554-a90c-034e9602b91b taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.440632] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.440686] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.440903] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.440981] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55f154d6-8c77-4554-a90c-034e9602b91b',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.441941] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.442042] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.442078] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.442237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.442311] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3e0de07-3f69-422a-b96d-525b1f2d6a80',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.443109] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2339818-d892-4139-9105-430d1c6dde2e taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.443208] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.443269] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.443427] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.443556] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2339818-d892-4139-9105-430d1c6dde2e',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.444179] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5cb5dff3-3fac-48a6-b59f-5932902148b8 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.444278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.444329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.444478] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.444552] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5cb5dff3-3fac-48a6-b59f-5932902148b8',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.445251] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.445345] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.445423] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.445552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.445624] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2840b5fb-3a8f-4d93-a381-953dc8e31a67',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.446318] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.446525] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.446591] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.446744] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.446818] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b037ccd-78b0-43be-acdd-bcc8531b52f5',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.447704] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efef42a0-7879-4e5e-b07d-896b827035c2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.447704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.447704] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.447944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.447944] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efef42a0-7879-4e5e-b07d-896b827035c2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.448547] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efc14d56-7e2f-4186-9451-37adac5c5b23 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.448684] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.448720] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.448847] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.448919] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efc14d56-7e2f-4186-9451-37adac5c5b23',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.449576] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.449681] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.449764] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.449943] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.450074] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08640a4a-b7e4-4d8a-81e0-f0c8623136ac',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.452353] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.452425] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.452460] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.452612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.452686] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.453372] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6c444ae-af25-4279-9215-0b11d2e72a27 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.453467] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.453596] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.453892] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.453971] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6c444ae-af25-4279-9215-0b11d2e72a27',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.454682] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.454790] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.454867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.455029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.455094] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0551ddf-e014-4e0b-b17c-9e30f1dac015',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.455788] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb1c245e-fab2-4558-9acb-1f5c9442e963 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.455879] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.455912] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.456080] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.456154] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb1c245e-fab2-4558-9acb-1f5c9442e963',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.456830] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.456921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.456987] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.457175] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.457326] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0cfaaa6-931d-4c7a-9f80-bc3fea212be2',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.458121] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42671b00-adb1-46b6-9948-92a484306fcc taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.458216] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.458293] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.458436] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.458507] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42671b00-adb1-46b6-9948-92a484306fcc',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.961261] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.961409] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.961483] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.961698] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.961861] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.961962] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.962041] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.962193] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.962283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.962367] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.962454] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.029127] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.029350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.029350] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.029550] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.031212] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.031311] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.033642] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.033768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.034482] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.034583] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.040173] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.040344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.041042] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.041136] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.042335] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.042435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.045653] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.045749] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.047773] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.047881] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.048650] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.048748] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.051332] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.051435] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.054146] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.054732] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.054927] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fe47e7d-d5da-4198-a8d5-ecc0c017948d is going to be deleted. [ 1553.055873] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.056109] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.057908] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.058012] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.068483] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.068604] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.069300] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.069907] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.070083] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.076256] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.076831] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.077029] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.077774] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.078217] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.078319] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.078953] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.079371] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.079485] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.080116] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.080567] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.080662] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.081318] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.081731] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.081826] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.082461] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.082866] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.082983] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0cfaaa6-931d-4c7a-9f80-bc3fea212be2 is going to be deleted. [ 1553.083928] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.084165] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.102496] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.102684] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf62572c-aed8-4405-8e2e-513d1f9f3976 is going to be deleted. [ 1553.103615] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.103833] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.120743] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.120951] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.136278] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.136420] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3522e3c-b40f-4d43-97bb-6926b26f91d0 is going to be deleted. [ 1553.137397] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.137612] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.139054] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.139162] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.171273] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.171457] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.172314] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.172442] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55f154d6-8c77-4554-a90c-034e9602b91b is going to be deleted. [ 1553.173333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.173552] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.225927] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.226105] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2840b5fb-3a8f-4d93-a381-953dc8e31a67 is going to be deleted. [ 1553.226942] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.227236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.271778] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.271968] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.276907] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.277038] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42671b00-adb1-46b6-9948-92a484306fcc is going to be deleted. [ 1553.278017] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.278280] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.302838] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.303036] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.348808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.348964] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efc14d56-7e2f-4186-9451-37adac5c5b23 is going to be deleted. [ 1553.349954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.350209] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.409371] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.409571] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.412568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.412703] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08640a4a-b7e4-4d8a-81e0-f0c8623136ac is going to be deleted. [ 1553.413625] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.413843] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.456584] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.456584] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2339818-d892-4139-9105-430d1c6dde2e is going to be deleted. [ 1553.457587] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.457820] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.462728] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.462930] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.468295] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.486857] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.487058] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.496780] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.496934] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3e0de07-3f69-422a-b96d-525b1f2d6a80 is going to be deleted. [ 1553.498104] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.498257] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.547951] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.548160] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.552236] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.552475] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb1c245e-fab2-4558-9acb-1f5c9442e963 is going to be deleted. [ 1553.553348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.553568] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.602916] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.603095] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b037ccd-78b0-43be-acdd-bcc8531b52f5 is going to be deleted. [ 1553.603997] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.604237] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.620725] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.620917] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.640027] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.640226] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.643344] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.643480] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5cb5dff3-3fac-48a6-b59f-5932902148b8 is going to be deleted. [ 1553.644410] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.644630] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.672249] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.672395] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0551ddf-e014-4e0b-b17c-9e30f1dac015 is going to be deleted. [ 1553.673323] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.673545] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.694622] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.694807] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.762817] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.762998] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6c444ae-af25-4279-9215-0b11d2e72a27 is going to be deleted. [ 1553.764020] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.764305] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.769529] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.769689] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.775221] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.775393] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.806277] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.806462] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.811516] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.811671] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efef42a0-7879-4e5e-b07d-896b827035c2 is going to be deleted. [ 1553.812944] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.813077] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.885142] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.885309] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a3954e3-aa9a-4782-b4a6-55e15592423d is going to be deleted. [ 1553.886271] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.886512] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.960253] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.960413] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.967619] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.967808] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.968899] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.969059] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e is going to be deleted. [ 1553.970098] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.970348] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.970473] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.970634] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fe47e7d-d5da-4198-a8d5-ecc0c017948d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.971046] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8653ee19-c57a-46f8-93e1-b1877cf8c937: rpc.has_security_group_logging(os_id): False [ 1553.971810] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.972026] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.972146] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.972283] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0cfaaa6-931d-4c7a-9f80-bc3fea212be2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.972940] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.973039] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.973157] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.973291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf62572c-aed8-4405-8e2e-513d1f9f3976" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.973768] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.973954] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.974064] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.974214] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3522e3c-b40f-4d43-97bb-6926b26f91d0" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.974354] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.974534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.974635] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.974767] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55f154d6-8c77-4554-a90c-034e9602b91b" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.974904] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.975095] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.975205] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.975329] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2840b5fb-3a8f-4d93-a381-953dc8e31a67" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.975887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.975887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.975887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.975887] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42671b00-adb1-46b6-9948-92a484306fcc" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.976068] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.976167] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.976261] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.977030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efc14d56-7e2f-4186-9451-37adac5c5b23" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.977030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.977030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.977030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.977030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08640a4a-b7e4-4d8a-81e0-f0c8623136ac" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.977030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.977291] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.977320] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.977424] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2339818-d892-4139-9105-430d1c6dde2e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.977582] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.977756] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.977839] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.977977] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3e0de07-3f69-422a-b96d-525b1f2d6a80" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.978133] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.978310] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.978387] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.978528] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb1c245e-fab2-4558-9acb-1f5c9442e963" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.978673] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.978840] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.978921] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.979073] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b037ccd-78b0-43be-acdd-bcc8531b52f5" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.979222] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.979388] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.979494] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.979619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0551ddf-e014-4e0b-b17c-9e30f1dac015" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.979777] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.979931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.980052] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.980174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5cb5dff3-3fac-48a6-b59f-5932902148b8" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.980333] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.980507] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.980592] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.980726] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6c444ae-af25-4279-9215-0b11d2e72a27" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.980875] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.981063] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.981151] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.981295] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efef42a0-7879-4e5e-b07d-896b827035c2" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.018768] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.018950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.018950] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.019148] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.034010] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.034207] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.070361] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.070577] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.071359] env[69274]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1554.071867] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.072170] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.072273] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.072342] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.072556] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.072643] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.072742] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1554.073830] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.074015] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.074140] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.074263] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a3954e3-aa9a-4782-b4a6-55e15592423d" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.074430] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.074590] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.074670] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.074872] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cfaa633-e1d1-45c7-ad35-59b0d5b35c1e" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.182702] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.182890] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.182931] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.183141] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.183294] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.212929] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1556.227147] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1556.227619] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.435318] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.435657] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.436756] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.437224] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.437351] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.437721] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.438683] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.439065] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.440393] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.440798] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1581.258674] env[69274]: INFO networking_nsxv3.common.synchronization [req-f24a29bf-9a9c-4e2a-8363-00308a872684 req-efd3d9a8-64c1-44b9-85d6-e43f730d05a8 tempest-ServerActionsTestJSON-21956224 tempest-ServerActionsTestJSON-21956224-project-member] Enqueued Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1581.258674] env[69274]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 with Priority: HIGHEST for action security_group_members [ 1581.258674] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock member-8653ee19-c57a-46f8-93e1-b1877cf8c937 taken with stack trace [, , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.258674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.258674] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.259030] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.259030] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.259725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.259725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.259725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.259725] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.259725] env[69274]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8653ee19-c57a-46f8-93e1-b1877cf8c937',) {} {{(pid=69274) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.763129] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.763129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.763129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.763129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.763129] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.763437] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.763437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.763437] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.763531] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.763648] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.763706] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 is going to be updated. [ 1581.791949] env[69274]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69274) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.792174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.792174] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.792380] env[69274]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.792534] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.801374] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: IN_PROGRESS for 2s [ 1583.812786] env[69274]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 in Status: SUCCESS [ 1583.813176] env[69274]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8653ee19-c57a-46f8-93e1-b1877cf8c937 deletion is rescheduled due to dependency. [ 1583.813176] env[69274]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8653ee19-c57a-46f8-93e1-b1877cf8c937" {{(pid=69274) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.259060] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1586.259389] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1591.260884] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.261274] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.262248] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.262641] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1601.263552] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.263920] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.264731] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.265206] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1611.266451] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1611.266818] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1616.268185] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1616.268628] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.270284] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1621.270585] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1626.271680] env[69274]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.271680] env[69274]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0